-- Logs begin at Fri 2022-05-27 15:22:47 UTC, end at Fri 2022-05-27 16:53:00 UTC. -- May 27 16:19:02.435428 dv-cinder-840493-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 16:19:02.444774 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 16:19:02 2022] *** May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: nodename: dv-cinder-840493-2-iscsi May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: machine: x86_64 May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: clock source: unix May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: pcre jit disabled May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: detected number of CPU cores: 4 May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: current working directory: / May 27 16:19:02.446753 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: detected binary path: /usr/bin/uwsgi-core May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: your processes number limit is 47680 May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: your memory page size is 4096 bytes May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: detected max file descriptor number: 2048 May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: lock engine: pthread robust mutexes May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: thunder lock: enabled May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 16:19:02.447416 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 16:19:02.491144 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: Python main interpreter initialized at 0x5555949159c0 May 27 16:19:02.491144 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: python threads support enabled May 27 16:19:02.491144 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: your server socket listen backlog is limited to 100 connections May 27 16:19:02.491144 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: your mercy for graceful operations on workers is 90 seconds May 27 16:19:02.491508 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: mapped 403077 bytes (393 KB) for 2 cores May 27 16:19:02.491610 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: *** Operational MODE: preforking *** May 27 16:19:02.491826 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: *** uWSGI is running in multiple interpreter mode *** May 27 16:19:02.491826 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: spawned uWSGI master process (pid: 103814) May 27 16:19:02.492304 dv-cinder-840493-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 16:19:02.493307 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: spawned uWSGI worker 1 (pid: 103815, cores: 1) May 27 16:19:02.493307 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: spawned uWSGI worker 2 (pid: 103816, cores: 1) May 27 16:19:02.494874 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 16:19:03.672135 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 16:19:03.688817 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 16:19:04.409175 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:04.409175 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: from cryptography.utils import int_from_bytes May 27 16:19:04.409522 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:04.409522 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: from cryptography.utils import int_from_bytes May 27 16:19:04.409522 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:04.409522 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: from cryptography.utils import int_from_bytes May 27 16:19:04.409805 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:04.409805 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: from cryptography.utils import int_from_bytes May 27 16:19:07.041307 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:19:07.042012 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:19:07.042175 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:19:07.042528 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:19:07.042779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:19:07.043159 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.043480 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.043798 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.044114 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.044434 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.044742 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.045054 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.045397 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.045718 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.045971 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.046282 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.046601 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840493-2-iscsi {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.046914 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.047217 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.047522 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.047839 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.048139 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.048454 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.048642 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:19:07.049035 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.049132 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:19:07.049227 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.049652 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:19:07.049818 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.049941 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:19:07.050061 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.050180 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:19:07.050996 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.051228 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.051336 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.051540 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.051757 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.051854 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052088 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052235 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052414 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052515 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052747 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.052847 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053051 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053144 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053434 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053566 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840493-2-iscsi {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053842 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.053955 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.054150 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.054421 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.054701 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.054869 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055026 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055346 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840493-2-iscsi {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055517 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055657 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055862 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.055997 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056109 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056266 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056422 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056585 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056742 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.056896 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.057201 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.057305 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.057539 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.057628 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.057932 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058030 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058249 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058345 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058571 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058667 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058871 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.058966 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059178 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059282 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059484 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059582 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059801 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.059894 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060151 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060287 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060446 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060534 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060694 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060789 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.060997 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061099 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061323 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061491 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840493-2-iscsi {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061661 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061816 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.061979 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062069 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062229 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062366 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062478 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.062865 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063094 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063219 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063397 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063490 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063701 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.063794 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064003 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064090 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064398 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064608 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064702 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.064910 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065003 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065211 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065297 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065538 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065625 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.065877 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066033 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066561 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066665 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066665 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066863 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.066977 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067072 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067285 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067371 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067598 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067767 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.067854 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068017 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068147 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068322 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068470 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068662 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068792 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.068975 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069161 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069464 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069608 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069695 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.069925 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070018 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070230 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070403 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070532 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070618 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070834 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.070927 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071139 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071237 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071448 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071554 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071743 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071841 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.071992 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072086 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072291 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072593 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072679 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.072905 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073004 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073207 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073292 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073537 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073634 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073841 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.073928 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074136 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074225 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074442 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074542 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074745 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.074839 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075047 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075140 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075349 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075443 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075650 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075744 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.075952 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076039 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076255 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076355 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076556 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076642 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076863 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.076991 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077176 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077285 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077515 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077610 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077819 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.077921 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078119 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078225 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078423 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078548 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078719 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.078833 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079024 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079120 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079324 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079469 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079627 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079714 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.079934 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080028 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080236 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080320 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080535 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080623 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080836 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.080935 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081140 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081216 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081563 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081664 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081802 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.081950 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082109 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082252 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082415 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082543 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082723 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.082855 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083031 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083160 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083338 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083460 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083643 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083761 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.083960 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084046 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084277 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084362 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084582 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084671 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084887 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.084979 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085191 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085286 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085520 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085615 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085834 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.085926 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086222 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086374 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086471 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086549 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086736 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.086826 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087037 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087134 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087370 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087479 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087660 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.087756 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.087950 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.088185 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.088269 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.088346 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.088563 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.088671 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.088860 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.088960 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.089167 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.089262 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.089506 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.089595 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.089817 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.089920 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.090122 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.090215 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.090426 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.090513 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.090730 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.090818 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.091033 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.091119 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.091336 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.091440 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.091638 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.091762 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.091942 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.092039 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.092241 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.092335 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.092556 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.092650 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.092863 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.092964 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.093170 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.093268 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.093500 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.093592 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.093808 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.093900 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.094126 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.094241 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:07.094462 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.094683 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095008 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095189 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095422 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095687 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095773 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.095943 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096086 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096301 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096604 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096795 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096883 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.096958 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.097037 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.097644 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.097796 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.097899 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098038 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098155 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098230 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098307 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098379 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098457 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098636 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098741 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.098941 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099071 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099255 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099362 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099560 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099707 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099864 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.099959 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100170 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100264 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100478 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100579 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100811 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.100946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101098 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101187 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101435 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101527 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101746 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.101860 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102057 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102157 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102362 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102449 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102669 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102835 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.102971 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103155 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103256 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103480 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103579 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103801 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.103888 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.104117 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.104209 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.104417 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.104538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.104829 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105004 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105326 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105545 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105545 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105861 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.105961 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.106146 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.106263 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.106506 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.106696 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.106923 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.112759 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.114531 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116075 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116180 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116273 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116365 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116446 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116532 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.116922 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117013 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117093 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117211 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117282 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117378 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117449 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117515 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117580 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117659 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117747 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117827 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117893 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.117977 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118063 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118149 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118229 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118306 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118384 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118461 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118546 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118709 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118791 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118869 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.118946 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119024 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119162 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119260 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119341 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119419 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119496 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119623 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119719 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119799 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119877 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.119954 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120031 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120150 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120246 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120334 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120413 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120490 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120567 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120645 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120740 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120827 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120914 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.120993 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121070 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121156 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121236 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121236 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121411 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121492 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121570 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121661 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121741 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121820 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121898 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.121976 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122062 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122150 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122229 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122471 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122549 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122640 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122726 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122812 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.122891 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123020 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123117 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123204 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123292 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123377 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123468 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123548 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123691 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123773 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123851 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.123934 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124014 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124091 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124180 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124261 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124338 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124426 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124505 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124581 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124672 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124751 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124828 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124905 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.124981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125066 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125144 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125228 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125307 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125403 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125482 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125654 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125739 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125824 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125903 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.125980 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126069 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126156 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126234 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126355 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126481 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126564 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126731 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126815 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.126894 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127028 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127120 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127200 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127277 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127354 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127508 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127593 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127672 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127750 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127826 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127903 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.127980 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128066 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128234 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128365 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128659 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128856 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.128966 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.129284 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.129595 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.129731 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.129938 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.130273 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.130419 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.130558 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.130674 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.130895 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131015 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131212 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131338 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131513 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131671 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131825 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.131969 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.132331 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.132655 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.132971 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.133300 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.133643 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.133746 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.133967 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134127 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134275 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134363 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134593 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134690 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.134933 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135032 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135268 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135363 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135588 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135716 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.135961 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136063 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136226 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136323 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136536 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136637 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136845 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.136933 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.137159 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.137246 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.137501 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.137686 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.137804 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138004 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138110 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138331 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138427 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138646 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138748 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.138967 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139074 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139277 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139381 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139604 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139707 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.139913 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140044 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140226 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140378 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140524 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140666 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140849 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.140999 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141142 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141295 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141572 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141664 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141774 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.141872 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142081 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142177 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142389 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142509 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142694 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142802 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.142999 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143097 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143325 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143413 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143634 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143721 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.143938 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.144070 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.144302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.144391 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.144618 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.144703 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145041 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145140 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145388 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145554 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145701 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.145789 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146020 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146118 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146333 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146412 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146642 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146719 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.146949 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147038 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147270 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147380 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147571 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147667 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147881 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.147970 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148189 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148277 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148514 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148602 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148818 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.148906 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149123 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149210 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149455 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149545 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149763 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.149865 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150068 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150167 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150374 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150506 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150680 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.150952 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151042 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151280 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151367 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151592 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151681 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.151908 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152004 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152227 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152339 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152533 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152622 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152847 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.152936 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153185 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153286 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153494 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153587 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153814 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.153914 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154118 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154206 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154422 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154523 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154724 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.154813 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155032 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155122 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155334 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155636 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155725 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.155937 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156026 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156244 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156334 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156543 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156638 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156844 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.156939 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157144 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157234 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157469 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157561 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157781 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.157869 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158087 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158365 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158452 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158679 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158774 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.158995 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.159094 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.159299 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.159388 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160172 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160276 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160514 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160655 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160821 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.160966 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.161160 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.161249 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.161488 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.161656 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.161823 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162017 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162146 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162335 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162484 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162647 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162786 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.162956 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163084 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163271 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163403 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163582 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163702 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.163889 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164002 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164196 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164291 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164507 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164596 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164811 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.164899 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165117 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165214 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165447 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165539 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165754 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.165855 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166067 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166168 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166369 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166458 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166666 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166754 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.166971 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167075 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167271 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167360 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167579 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167887 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.167984 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168185 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168272 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168485 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168629 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168773 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.168926 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169065 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169214 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169478 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169631 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169799 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.169900 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170038 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170194 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170345 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170508 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170648 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170810 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.170909 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171133 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171229 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171438 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171541 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171743 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.171832 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172048 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172143 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172358 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172448 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172664 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172751 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.172965 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173053 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173276 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173387 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173637 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173745 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.173949 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174097 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174259 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174410 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174540 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174632 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174844 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.174993 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.175160 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.175996 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.176153 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.176333 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.176491 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.176662 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.176822 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177003 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177129 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177250 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177466 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177607 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177780 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.177945 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178071 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178260 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178385 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178560 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178691 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.178860 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179008 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179161 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179316 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179460 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179621 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179778 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.179925 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180083 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180237 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180382 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180546 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180851 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.180983 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.181175 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.181322 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.181526 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.181649 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.181834 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182003 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182140 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182307 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182450 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182619 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182755 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.182934 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183107 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183245 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183370 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183555 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183691 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.183864 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184007 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184164 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184312 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184476 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184623 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184783 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.184928 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185090 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185234 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185411 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185568 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185715 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.185878 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186031 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186181 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186339 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186485 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186647 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186788 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.186962 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187091 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187278 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187394 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187603 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187722 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.187905 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188032 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188211 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188331 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188519 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188628 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188824 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.188934 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189130 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189274 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189459 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189601 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189768 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.189961 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190077 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190269 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190369 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190589 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190704 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.190984 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191093 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191313 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191445 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191710 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191784 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.191909 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192062 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192209 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192367 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192530 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192682 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192835 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.192987 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193136 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193302 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193465 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193610 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193772 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.193919 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194075 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194237 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194374 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194549 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194805 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.194905 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195111 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195199 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195418 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195505 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195721 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.195810 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196028 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196114 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196335 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196429 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196646 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196734 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.196954 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197041 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197254 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197371 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197595 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197692 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197908 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.197996 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198220 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198307 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198532 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198628 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198845 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.198933 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199148 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199248 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199453 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199541 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199762 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.199854 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200061 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200156 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200362 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200450 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200701 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200802 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.200977 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201120 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201277 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201386 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201628 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201716 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.201973 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.202071 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.202285 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.202373 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.202588 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.202709 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203021 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203176 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203324 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203415 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203630 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203727 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.203952 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204052 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204265 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204355 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204582 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204671 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204883 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.204973 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205191 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205280 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205523 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205615 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205843 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.205980 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.206163 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.206294 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.206513 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.206823 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.206905 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207142 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207331 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207450 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207755 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.207975 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208063 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208289 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208379 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208610 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208716 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.208966 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209053 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209271 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209406 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209622 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209719 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.209929 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210030 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210249 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210336 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210557 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210667 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210863 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.210977 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211166 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211258 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211468 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211676 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211774 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.211991 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212080 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212303 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212390 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212625 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212721 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.212946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213038 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213251 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213359 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213579 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213679 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213882 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.213992 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214194 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214303 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214492 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214589 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214813 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.214915 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215123 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215254 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215422 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215505 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215730 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.215833 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216028 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216115 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216345 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216449 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216651 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216740 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.216953 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217051 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217258 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217418 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217584 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217707 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.217920 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218009 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218221 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218318 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218538 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218626 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218862 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.218964 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219185 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219273 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219489 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219584 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219808 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.219903 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220113 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220201 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220428 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220516 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220728 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.220823 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221042 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221143 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221354 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221478 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221820 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.221962 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.222052 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.222864 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.222969 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223187 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223360 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223491 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223670 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223901 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.223990 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224233 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224351 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224561 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224667 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224860 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.224950 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225167 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225256 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225497 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225601 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225814 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.225903 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226120 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226210 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226423 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226556 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226724 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.226821 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227025 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227121 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227357 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227444 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227659 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227763 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.227997 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228088 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228314 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228402 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228625 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228722 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.228948 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229035 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229256 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229409 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229602 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229706 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.229920 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.230013 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.230231 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.230319 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.230818 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.230932 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231018 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231107 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231174 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231246 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231435 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231549 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231744 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.231846 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232044 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232140 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232352 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232441 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232654 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232750 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.232956 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233044 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233261 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233538 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233632 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233867 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.233963 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234180 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234270 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234492 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234584 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234794 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.234882 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235101 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235190 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235406 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235492 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235710 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.235805 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236018 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236107 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236325 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236421 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236631 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236734 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.236974 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.237113 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.237295 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.237483 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.237634 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.237807 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.238475 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.238596 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.238800 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.238908 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239114 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239269 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239432 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239740 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.239968 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240056 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240323 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240423 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240638 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240726 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.240947 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.241034 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.241259 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.241377 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.241850 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.241952 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.242168 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.242267 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.242477 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.242726 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.242822 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243054 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243144 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243370 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243459 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243768 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.243991 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244089 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244301 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244389 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244611 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244699 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.244920 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245020 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245230 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245327 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245567 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245657 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.245880 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246049 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246193 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246280 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246505 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246592 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.246828 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247028 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247164 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247342 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247480 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247671 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247798 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.247992 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248114 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248313 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248429 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248627 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248783 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.248941 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249098 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249263 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249425 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249611 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249741 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.249913 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250056 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250221 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250371 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250529 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250682 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250832 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.250993 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251150 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251306 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251453 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251676 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251777 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.251923 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252048 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252232 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252354 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252542 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252860 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.252948 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.253183 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.253280 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.253560 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.253752 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.253880 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254092 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254179 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254418 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254510 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254737 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.254836 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255042 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255302 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255382 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255617 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255713 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.255946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256034 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256269 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256359 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256595 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256684 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.256912 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257000 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257230 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257319 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257583 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257673 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257886 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.257973 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258190 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258278 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258496 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258592 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258801 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.258898 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259105 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259191 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259417 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259504 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259720 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.259819 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260024 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260136 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260343 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260431 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260652 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260750 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.260976 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261193 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261280 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261564 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261665 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261886 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.261987 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262208 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262298 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262640 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262838 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.262926 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263148 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263244 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263446 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263542 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263752 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264058 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264144 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264373 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264475 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264685 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264824 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.264982 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.265071 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.265283 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.265441 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.265717 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.265978 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.266161 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.266426 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.266627 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.266978 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.267138 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.267297 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.267384 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.267559 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.267787 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.268051 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.268171 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.268171 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.268609 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.268803 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.269290 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.269472 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.269790 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.270016 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.270200 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.270383 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.270581 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.270669 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271013 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271194 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271305 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271831 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.271991 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272086 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272169 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272169 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272323 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272405 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272473 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272547 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272614 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272679 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272769 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272856 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272943 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.272943 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273086 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273173 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273253 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273466 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273545 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273637 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273731 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273813 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273892 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.273971 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274049 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274127 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274244 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274335 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274554 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274642 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274887 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.274975 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.275203 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.275431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.275520 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.275767 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.275855 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276088 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276185 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276407 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276502 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276715 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.276803 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277026 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277146 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277332 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277443 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277660 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277767 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.277985 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278080 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278296 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278384 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278599 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278697 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.278908 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279003 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279220 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279321 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279530 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279632 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279838 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.279927 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280149 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280237 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280459 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280585 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280769 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.280866 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281077 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281166 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281415 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281520 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281727 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.281805 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282080 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282229 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282351 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282440 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282683 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.282765 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283008 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283094 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283315 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283406 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283610 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283689 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283910 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.283989 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.284215 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.284295 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.284529 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.285121 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.285434 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.285573 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.285736 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.285925 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286047 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286243 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286386 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286577 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286692 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286890 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.286997 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287197 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287293 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287588 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287676 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287892 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.287989 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288190 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288287 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288489 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288585 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288788 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.288876 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289087 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289184 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289408 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289501 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289710 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.289799 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290016 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290112 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290315 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290394 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290615 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290703 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.290915 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291013 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291213 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291328 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291510 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291719 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291831 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.291959 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292194 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292285 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292456 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292559 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292774 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.292852 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293090 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293187 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293431 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293523 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293740 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.293831 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294055 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294141 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294368 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294454 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294672 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294751 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.294973 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295049 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295315 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295421 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295585 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295676 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295890 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.295967 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296191 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296287 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296495 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296586 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296798 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.296884 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297100 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297188 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297448 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297531 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297773 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.297854 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298125 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298226 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298382 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298687 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298765 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.298991 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.299070 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.299294 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.299373 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.299596 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.299730 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.300153 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.300311 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.300311 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301249 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301249 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301601 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301723 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301830 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.301990 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302106 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302309 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302411 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302614 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302693 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.302933 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303019 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303255 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303353 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303571 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303669 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303875 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.303963 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304199 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304296 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304532 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304625 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304860 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.304957 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305166 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305248 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305536 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305638 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305857 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.305936 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306167 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306256 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306474 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306561 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306778 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.306855 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.307020 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:19:07.307099 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.307411 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.307733 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.308053 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.308412 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.308729 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.309058 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.309615 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.309806 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.309995 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.310295 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.310607 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.310926 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.311245 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.311603 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.311940 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.312248 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.312566 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.312892 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.313243 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.313581 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.313922 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.314248 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.314563 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.314877 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.315184 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:07.315426 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:19:07.366151 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO dbcounter [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Registered counter for database nova_api May 27 16:19:07.375456 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO dbcounter [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Registered counter for database nova_api May 27 16:19:07.387556 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_db.sqlalchemy.engines [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.394983 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writer thread running {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.399229 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.408355 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writer thread running {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.452075 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.context [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6293b2d6-a723-4343-b59c-2c55f0df4078(cell1) {{(pid=103816) load_cells /opt/stack/nova/nova/context.py:464}} May 27 16:19:07.456132 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:19:07.458489 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:19:07.459303 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:19:07.461312 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:19:07.463350 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO dbcounter [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Registered counter for database nova_cell0 May 27 16:19:07.466354 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.context [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6293b2d6-a723-4343-b59c-2c55f0df4078(cell1) {{(pid=103815) load_cells /opt/stack/nova/nova/context.py:464}} May 27 16:19:07.467384 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO dbcounter [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Registered counter for database nova_cell1 May 27 16:19:07.470618 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_concurrency.lockutils [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:19:07.472743 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_concurrency.lockutils [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:19:07.473656 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_concurrency.lockutils [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:19:07.475198 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_db.sqlalchemy.engines [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.475712 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_concurrency.lockutils [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:19:07.477396 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_db.sqlalchemy.engines [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.477804 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO dbcounter [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Registered counter for database nova_cell0 May 27 16:19:07.481992 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO dbcounter [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Registered counter for database nova_cell1 May 27 16:19:07.482451 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writer thread running {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.489946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.491347 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.504383 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writer thread running {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.504983 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writer thread running {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.632285 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writer thread running {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.641709 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO dbcounter [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Registered counter for database nova_cell0 May 27 16:19:07.651404 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_db.sqlalchemy.engines [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.654765 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO dbcounter [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Registered counter for database nova_cell0 May 27 16:19:07.656350 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writer thread running {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:07.664264 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:07.668885 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writer thread running {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:08.098110 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: WARNING keystonemiddleware.auth_token [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:19:08.105475 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: WARNING keystonemiddleware.auth_token [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:19:08.126270 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: WARNING keystonemiddleware.auth_token [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:19:08.134362 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: WARNING keystonemiddleware.auth_token [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:19:08.449854 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: WARNING keystonemiddleware.auth_token [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:19:08.455875 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: WARNING keystonemiddleware.auth_token [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:19:08.461800 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555949159c0 pid: 103816 (default app) May 27 16:19:08.463898 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:19:08.465089 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 May 27 16:19:08.465535 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri May 27 16:19:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:19:08.478698 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: WARNING keystonemiddleware.auth_token [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:19:08.484580 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: WARNING keystonemiddleware.auth_token [None req-2d6a2620-45ce-4f50-8185-34c5ae89e60e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:19:08.489985 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555949159c0 pid: 103815 (default app) May 27 16:20:33.515937 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:33.516842 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 May 27 16:20:33.517210 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:33.534916 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_api:SELECT=3 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.538565 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_cell1:SELECT=3 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.539680 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_cell0:SELECT=3 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.540720 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.000052 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-47e3ee74-4194-4d5c-adf4-70d32b9d7d5f admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:34.032680 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-47e3ee74-4194-4d5c-adf4-70d32b9d7d5f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508307 May 27 16:20:34.033238 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Fri May 27 16:20:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:20:36.376215 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:36.377222 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-1a8070ed-ccc4-4144-b76d-54b47322269a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 27 16:20:36.378047 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:20:36.448591 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-d5c61c06-62ea-4bcb-92d5-6663e0e0277b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "swap": 0}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:36.469165 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:20:36.469165 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: warnings.warn(msg) May 27 16:20:36.604490 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-d5c61c06-62ea-4bcb-92d5-6663e0e0277b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.218678 May 27 16:20:36.607340 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:20:36.619513 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_api:SELECT=3 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.621173 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_cell1:SELECT=3 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.622487 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_cell0:SELECT=3 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.624523 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.831233 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-04099219-5ac8-4c98-94cb-d100768b9757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:36.833691 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:20:36.833691 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:20:36.979172 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-04099219-5ac8-4c98-94cb-d100768b9757 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364961 May 27 16:20:36.980008 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Fri May 27 16:20:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:20:39.375681 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-d5c61c06-62ea-4bcb-92d5-6663e0e0277b admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:39.377448 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-d5c61c06-62ea-4bcb-92d5-6663e0e0277b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 May 27 16:20:39.378252 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:39.503414 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-a85344ce-ec63-4c4c-82fa-735d79e9c62f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "name": "ds512M"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:39.521605 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:20:39.521605 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:20:39.596728 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-a85344ce-ec63-4c4c-82fa-735d79e9c62f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.212164 May 27 16:20:39.597283 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:20:39.609004 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-d26020cf-ad1f-4b74-91b2-d736e71bbccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:39.610877 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:20:39.610877 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: warnings.warn(msg) May 27 16:20:39.731657 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-d26020cf-ad1f-4b74-91b2-d736e71bbccb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126076 May 27 16:20:39.733395 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Fri May 27 16:20:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:20:42.069705 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-a85344ce-ec63-4c4c-82fa-735d79e9c62f admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:42.071639 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-a85344ce-ec63-4c4c-82fa-735d79e9c62f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002456 May 27 16:20:42.072045 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:20:42.146834 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-989f27d9-ff96-486e-bc09-5bfb16cdc0dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:42.276835 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-989f27d9-ff96-486e-bc09-5bfb16cdc0dc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.193483 May 27 16:20:42.281689 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 16:20:42.295465 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-9318e91b-0ef5-47f8-b59e-3b0bfa7966c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:42.437432 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-9318e91b-0ef5-47f8-b59e-3b0bfa7966c8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148990 May 27 16:20:42.441920 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Fri May 27 16:20:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:20:44.832123 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-989f27d9-ff96-486e-bc09-5bfb16cdc0dc admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:44.833145 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-989f27d9-ff96-486e-bc09-5bfb16cdc0dc admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 27 16:20:44.833873 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:44.900433 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-45e72d91-7132-4a15-a940-7b8bc7977f93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "id": "d3", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:44.985681 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-45e72d91-7132-4a15-a940-7b8bc7977f93 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145699 May 27 16:20:44.986318 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:20:44.999178 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0a7ab6d9-399e-4175-ae43-5834f4d62c3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:45.096610 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-0a7ab6d9-399e-4175-ae43-5834f4d62c3d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101875 May 27 16:20:45.097326 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Fri May 27 16:20:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:20:47.416457 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-45e72d91-7132-4a15-a940-7b8bc7977f93 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:47.417485 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-45e72d91-7132-4a15-a940-7b8bc7977f93 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 27 16:20:47.417914 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:47.480456 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "swap": 0, "vcpus": 4, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:47.555968 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131327 May 27 16:20:47.556658 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:20:47.569784 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-928d2a3c-1a98-4380-9601-af5980517a6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:47.661084 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-928d2a3c-1a98-4380-9601-af5980517a6c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094871 May 27 16:20:47.661727 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Fri May 27 16:20:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:20:50.019191 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:50.020856 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002512 May 27 16:20:50.021384 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:50.086470 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-c21296ed-4458-408a-9e83-4b5692dd6485 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:50.113145 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-c21296ed-4458-408a-9e83-4b5692dd6485 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085199 May 27 16:20:50.121443 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Fri May 27 16:20:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:20:52.451945 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:52.453274 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-952116a7-f347-4e62-81b4-5380bfef3193 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001720 May 27 16:20:52.453749 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:20:52.530964 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-9c100598-b3c2-4349-9162-1040806f4584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "ram": 512}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:52.626101 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-9c100598-b3c2-4349-9162-1040806f4584 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.166030 May 27 16:20:52.626662 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:20:52.648501 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-456a2bcf-a9c2-41a5-9c26-bcc23e9258aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:52.755486 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-456a2bcf-a9c2-41a5-9c26-bcc23e9258aa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120421 May 27 16:20:52.757410 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Fri May 27 16:20:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:20:55.138604 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-9c100598-b3c2-4349-9162-1040806f4584 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:55.140411 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-9c100598-b3c2-4349-9162-1040806f4584 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003145 May 27 16:20:55.141072 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:55.222106 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-91d7b55f-dd3c-45a6-a8d5-26c3f166938d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "id": "2"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:55.370917 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-91d7b55f-dd3c-45a6-a8d5-26c3f166938d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.221019 May 27 16:20:55.371861 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 16:20:55.388578 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-ea04ad06-78e7-4489-9597-3a81f6da8472 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:55.525795 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-ea04ad06-78e7-4489-9597-3a81f6da8472 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142943 May 27 16:20:55.526244 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Fri May 27 16:20:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:20:58.054405 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-91d7b55f-dd3c-45a6-a8d5-26c3f166938d admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:20:58.056089 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-91d7b55f-dd3c-45a6-a8d5-26c3f166938d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002459 May 27 16:20:58.056610 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:20:58.141191 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-84b2882d-6f69-40b4-96de-949f098ed577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:58.249278 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-84b2882d-6f69-40b4-96de-949f098ed577 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.185685 May 27 16:20:58.250095 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:20:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 16:20:58.262170 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-fb1539c2-7946-4fa4-8a3d-27d3257ab67a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:20:58.350073 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-fb1539c2-7946-4fa4-8a3d-27d3257ab67a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091727 May 27 16:20:58.350678 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Fri May 27 16:20:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:21:00.800904 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-84b2882d-6f69-40b4-96de-949f098ed577 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:00.802048 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-84b2882d-6f69-40b4-96de-949f098ed577 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 27 16:21:00.802446 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:00.861987 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0567845e-200d-4a49-a311-bab9f57106b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "name": "m1.large"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:00.990666 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-0567845e-200d-4a49-a311-bab9f57106b3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.181804 May 27 16:21:00.991278 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:21:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:01.004215 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-96ce0984-a208-4149-8e9a-f6d901cf3167 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:01.140613 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-96ce0984-a208-4149-8e9a-f6d901cf3167 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140142 May 27 16:21:01.141194 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Fri May 27 16:21:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:21:03.646915 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0567845e-200d-4a49-a311-bab9f57106b3 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:03.648612 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-0567845e-200d-4a49-a311-bab9f57106b3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 May 27 16:21:03.649115 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:21:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:03.733261 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5"}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:03.932455 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.276258 May 27 16:21:03.943876 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Fri May 27 16:21:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:03.950438 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e8b45f05-78a5-4fe9-bad9-3040577f2334 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:03.960847 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:04.148489 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e8b45f05-78a5-4fe9-bad9-3040577f2334 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.202628 May 27 16:21:04.149873 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Fri May 27 16:21:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:21:29.646802 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:29.648191 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 May 27 16:21:29.648712 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:29.712071 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-462a1078-6a49-40bf-a753-63eff120bb7c admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:29.729424 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-462a1078-6a49-40bf-a753-63eff120bb7c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073832 May 27 16:21:29.729985 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Fri May 27 16:21:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:21:30.742502 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:30.743509 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-417564ab-bf1b-49fc-b5b6-580d1e3a04ec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 27 16:21:30.743921 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:30.943787 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c03f18b5-34e7-40aa-88a2-5c268d404ce1 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:30.950683 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.wsgi [None req-c03f18b5-34e7-40aa-88a2-5c268d404ce1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c03f18b5-34e7-40aa-88a2-5c268d404ce1 admin admin] Request method failure captured: May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept: application/json May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept-Encoding: gzip, deflate May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Connection: keep-alive May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Content-Length: 0 May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Host: 10.222.0.42 May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-Api-Version: compute 2.90 May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-System-Scope: None May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: User-Agent: python-novaclient May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Auth-Token: gAAAAABikPqKfkFjjzyrf-yzcz_paxjI38GGJMEPg72CXKdnM1LJisoH4WGA5MDvupYlTcbdY_oXB7-_2_oGsQb2YnxpXgfybpoHJkMl7kjZiX-j3b6QF3FBa0SQdKDFj-4NFlqQK_4m0H0ck76R-mgu0Nmq4VCdvL-p8t0hs3rOeNatD31gy3A May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Id: None May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Name: None May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Identity-Status: Confirmed May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Is-Admin-Project: True May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Id: default May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Name: Default May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Name: admin May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Role: reader,member,admin May 27 16:21:30.959393 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Roles: reader,member,admin May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant: admin May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Name: admin May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User: admin May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Id: default May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Name: Default May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Name: admin May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: method: > May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: exception: Flavor 42 could not be found. May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: action_args: {'id': '42'} May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:30.961431 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:30.962675 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:30.964981 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c03f18b5-34e7-40aa-88a2-5c268d404ce1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:30.966302 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c03f18b5-34e7-40aa-88a2-5c268d404ce1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068356 May 27 16:21:30.966302 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri May 27 16:21:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 16:21:30.966580 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-77d01d9f-3f42-4e42-b6e4-ebc8180fd6ec admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:30.969592 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.993148 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-77d01d9f-3f42-4e42-b6e4-ebc8180fd6ec admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030702 May 27 16:21:30.993748 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:21:31.004075 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c04c98ab-d724-4f93-894c-4c6fb9da385f admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:31.028051 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c04c98ab-d724-4f93-894c-4c6fb9da385f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027571 May 27 16:21:31.028624 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:21:31.038243 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-ad42405c-a5d9-4a81-b91a-7c1a9ca63bd8 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:31.044443 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.wsgi [None req-ad42405c-a5d9-4a81-b91a-7c1a9ca63bd8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-ad42405c-a5d9-4a81-b91a-7c1a9ca63bd8 admin admin] Request method failure captured: May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept: application/json May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept-Encoding: gzip, deflate May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Connection: keep-alive May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Content-Length: 0 May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Host: 10.222.0.42 May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-Api-Version: compute 2.90 May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-System-Scope: None May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: User-Agent: python-novaclient May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Auth-Token: gAAAAABikPqKfkFjjzyrf-yzcz_paxjI38GGJMEPg72CXKdnM1LJisoH4WGA5MDvupYlTcbdY_oXB7-_2_oGsQb2YnxpXgfybpoHJkMl7kjZiX-j3b6QF3FBa0SQdKDFj-4NFlqQK_4m0H0ck76R-mgu0Nmq4VCdvL-p8t0hs3rOeNatD31gy3A May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Id: None May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Name: None May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Identity-Status: Confirmed May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Is-Admin-Project: True May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Id: default May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Name: Default May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Name: admin May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Role: reader,member,admin May 27 16:21:31.047779 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Roles: reader,member,admin May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant: admin May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Name: admin May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User: admin May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Id: default May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Name: Default May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Name: admin May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: method: > May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: exception: Flavor 42 could not be found. May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: action_args: {'id': '42'} May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:31.049302 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:31.050467 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:31.051924 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-ad42405c-a5d9-4a81-b91a-7c1a9ca63bd8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:31.053138 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-ad42405c-a5d9-4a81-b91a-7c1a9ca63bd8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014756 May 27 16:21:31.053138 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri May 27 16:21:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 16:21:31.933577 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c04c98ab-d724-4f93-894c-4c6fb9da385f admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:31.935557 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c04c98ab-d724-4f93-894c-4c6fb9da385f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 May 27 16:21:31.936238 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:32.136185 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-3309a265-a761-4c14-9d52-f0484ea70ea7 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:32.139145 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.wsgi [None req-3309a265-a761-4c14-9d52-f0484ea70ea7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-3309a265-a761-4c14-9d52-f0484ea70ea7 admin admin] Request method failure captured: May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept: application/json May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept-Encoding: gzip, deflate May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Connection: keep-alive May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Content-Length: 0 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Host: 10.222.0.42 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-Api-Version: compute 2.90 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-System-Scope: None May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: User-Agent: python-novaclient May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Auth-Token: gAAAAABikPqLN2ooKKfzIsesyp5_OQuNa1pQ5Ot1nocSKocll6UQGTx5_Q31zE2RLGSaFwXeqyXm_SMyA__XtcPoHXpFFiQhz3_4sWh0G35xZbsdmGAaAp6Qpv-6zGaKOyBRYaxFOEQmXgudLDjZsH4U2g4Nke4uuvO5D-HoHgxETzB4OPKSSw0 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Id: None May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Name: None May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Identity-Status: Confirmed May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Is-Admin-Project: True May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Id: default May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Name: Default May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Name: admin May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Role: reader,member,admin May 27 16:21:32.140708 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Roles: reader,member,admin May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant: admin May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Name: admin May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User: admin May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Id: default May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Name: Default May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Name: admin May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: method: > May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: exception: Flavor 84 could not be found. May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: action_args: {'id': '84'} May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:32.142332 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:32.143306 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:32.144573 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-3309a265-a761-4c14-9d52-f0484ea70ea7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:32.145835 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-3309a265-a761-4c14-9d52-f0484ea70ea7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065782 May 27 16:21:32.146088 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri May 27 16:21:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 16:21:32.158847 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-01ce5560-7390-4037-a56b-061d554dc441 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:32.187746 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-01ce5560-7390-4037-a56b-061d554dc441 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035040 May 27 16:21:32.188795 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:21:32.199019 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-24ef3bb7-bd63-46c2-978d-0d12050bdd7d admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:32.213323 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-24ef3bb7-bd63-46c2-978d-0d12050bdd7d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017792 May 27 16:21:32.213913 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:21:32.223447 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-b670307c-887f-4679-bc67-242bc57d4f17 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:32.229568 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.wsgi [None req-b670307c-887f-4679-bc67-242bc57d4f17 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-b670307c-887f-4679-bc67-242bc57d4f17 admin admin] Request method failure captured: May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept: application/json May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept-Encoding: gzip, deflate May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Connection: keep-alive May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Content-Length: 0 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Host: 10.222.0.42 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-Api-Version: compute 2.90 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-System-Scope: None May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: User-Agent: python-novaclient May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Auth-Token: gAAAAABikPqLN2ooKKfzIsesyp5_OQuNa1pQ5Ot1nocSKocll6UQGTx5_Q31zE2RLGSaFwXeqyXm_SMyA__XtcPoHXpFFiQhz3_4sWh0G35xZbsdmGAaAp6Qpv-6zGaKOyBRYaxFOEQmXgudLDjZsH4U2g4Nke4uuvO5D-HoHgxETzB4OPKSSw0 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Id: None May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Name: None May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Identity-Status: Confirmed May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Is-Admin-Project: True May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Id: default May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Name: Default May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Name: admin May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Role: reader,member,admin May 27 16:21:32.231104 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Roles: reader,member,admin May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant: admin May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Name: admin May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User: admin May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Id: default May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Name: Default May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Name: admin May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: method: > May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: exception: Flavor 84 could not be found. May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: action_args: {'id': '84'} May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:32.233790 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:32.235538 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:32.237739 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-b670307c-887f-4679-bc67-242bc57d4f17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:32.239867 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-b670307c-887f-4679-bc67-242bc57d4f17 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012637 May 27 16:21:32.239867 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri May 27 16:21:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 16:21:33.132255 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-24ef3bb7-bd63-46c2-978d-0d12050bdd7d admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:33.133300 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-24ef3bb7-bd63-46c2-978d-0d12050bdd7d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 27 16:21:33.133727 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:33.331707 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0131913d-3038-43c0-a623-83d83b773f94 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:33.337593 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.wsgi [None req-0131913d-3038-43c0-a623-83d83b773f94 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0131913d-3038-43c0-a623-83d83b773f94 admin admin] Request method failure captured: May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept: application/json May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Accept-Encoding: gzip, deflate May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Connection: keep-alive May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Content-Length: 0 May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Host: 10.222.0.42 May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-Api-Version: compute 2.90 May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Openstack-System-Scope: None May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: User-Agent: python-novaclient May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Auth-Token: gAAAAABikPqNjgM6_f90iYoc7-myLAoRf7kTgoq5WGnpAAVJoQrJspB7SupSYR2bSw0qm9AHM0BsS26n_rOijQuZgPM3fTvDpwD9ETmvukrH6iQqXIoB2GIlHCKKFNOWVkNLpdkdyoDw4WUrHVXWFhDAwLsKfxkx9UwduVpxF1lqntZtYSyh8JA May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Id: None May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Domain-Name: None May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Identity-Status: Confirmed May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Is-Admin-Project: True May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Id: default May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Domain-Name: Default May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Project-Name: admin May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Role: reader,member,admin May 27 16:21:33.340219 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Roles: reader,member,admin May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant: admin May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-Tenant-Name: admin May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User: admin May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Id: default May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Domain-Name: Default May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: X-User-Name: admin May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: method: > May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: exception: Flavor 451 could not be found. May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: action_args: {'id': '451'} May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:33.341778 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:33.342871 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: ERROR nova.api.openstack.wsgi May 27 16:21:33.344215 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-0131913d-3038-43c0-a623-83d83b773f94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:33.345946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-0131913d-3038-43c0-a623-83d83b773f94 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064251 May 27 16:21:33.345946 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:21:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 16:21:33.352665 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-3bdad252-ed30-4f7b-9f90-c640f43f6506 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:33.369211 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-3bdad252-ed30-4f7b-9f90-c640f43f6506 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020790 May 27 16:21:33.369780 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:21:33.382818 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:33.398518 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021528 May 27 16:21:33.399074 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri May 27 16:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:21:33.409498 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-4e0d0c6d-a989-4259-91bf-cd062babd26d admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:33.414883 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.wsgi [None req-4e0d0c6d-a989-4259-91bf-cd062babd26d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-4e0d0c6d-a989-4259-91bf-cd062babd26d admin admin] Request method failure captured: May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept: application/json May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Accept-Encoding: gzip, deflate May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Connection: keep-alive May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Content-Length: 0 May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Host: 10.222.0.42 May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-Api-Version: compute 2.90 May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Openstack-System-Scope: None May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: User-Agent: python-novaclient May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Auth-Token: gAAAAABikPqNjgM6_f90iYoc7-myLAoRf7kTgoq5WGnpAAVJoQrJspB7SupSYR2bSw0qm9AHM0BsS26n_rOijQuZgPM3fTvDpwD9ETmvukrH6iQqXIoB2GIlHCKKFNOWVkNLpdkdyoDw4WUrHVXWFhDAwLsKfxkx9UwduVpxF1lqntZtYSyh8JA May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Id: None May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Domain-Name: None May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Identity-Status: Confirmed May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Is-Admin-Project: True May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Openstack-Nova-Api-Version: 2.90 May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Id: default May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Domain-Name: Default May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Project-Name: admin May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Role: reader,member,admin May 27 16:21:33.416949 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Roles: reader,member,admin May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b89eb764079a4814b557772bebc9a51d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b89eb764079a4814b557772bebc9a51d", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant: admin May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Id: b89eb764079a4814b557772bebc9a51d May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-Tenant-Name: admin May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User: admin May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Id: default May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Domain-Name: Default May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Id: e387d1cbdd3947bcb9659065cbae32c0 May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: X-User-Name: admin May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: method: > May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: exception: Flavor 451 could not be found. May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: action_args: {'id': '451'} May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:21:33.418652 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:33.419682 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: ERROR nova.api.openstack.wsgi May 27 16:21:33.420916 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-4e0d0c6d-a989-4259-91bf-cd062babd26d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:21:33.421951 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-4e0d0c6d-a989-4259-91bf-cd062babd26d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012570 May 27 16:21:33.421951 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:21:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 16:21:34.305966 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:34.307532 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 May 27 16:21:34.307943 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:34.497619 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-642b95d2-b667-4b69-8cdb-dadc9038c20e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:34.575549 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-642b95d2-b667-4b69-8cdb-dadc9038c20e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.132453 May 27 16:21:34.576040 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri May 27 16:21:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:35.492268 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:35.493278 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 27 16:21:35.493722 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:35.686455 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-3789a53a-f726-4496-946b-7833d4991bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:35.785190 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-3789a53a-f726-4496-946b-7833d4991bab admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.151143 May 27 16:21:35.785686 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri May 27 16:21:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:36.664010 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:36.665014 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 27 16:21:36.665524 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:21:36.855535 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-6043f8b3-d7e5-4f86-97de-90b8daf82ccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:36.958662 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-6043f8b3-d7e5-4f86-97de-90b8daf82ccb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.156345 May 27 16:21:36.959233 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri May 27 16:21:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:37.851560 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:37.853925 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002472 May 27 16:21:37.854641 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:38.053059 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-f8288c06-5d7c-45ad-af48-d23dfa806adf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:21:38.153097 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-f8288c06-5d7c-45ad-af48-d23dfa806adf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.157375 May 27 16:21:38.153097 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri May 27 16:21:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:21:39.068900 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:39.069948 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 27 16:21:39.070340 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:21:39.274376 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-913da8ab-18f9-47dc-9ec9-6df4fe0c2b12 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:21:39.295888 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-913da8ab-18f9-47dc-9ec9-6df4fe0c2b12 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081333 May 27 16:21:39.296434 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri May 27 16:21:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:22:42.528310 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.529327 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-e379dcc6-a039-4cf8-b052-322a3e959004 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 27 16:22:42.529783 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:22:42.538235 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:42.592050 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-ec97b37b-3018-4990-af80-4238d6446ce5 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.612659 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-ec97b37b-3018-4990-af80-4238d6446ce5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076496 May 27 16:22:42.613204 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:22:42.634480 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG dbcounter [-] [103815] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:42.638263 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-6315a165-ddc4-41e7-b4b3-b857f0c488aa admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.646770 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-6315a165-ddc4-41e7-b4b3-b857f0c488aa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013675 May 27 16:22:42.655366 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:22:42.659553 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-7b79ace5-3d05-4b69-8810-0530bda0f354 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.668091 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-7b79ace5-3d05-4b69-8810-0530bda0f354 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012576 May 27 16:22:42.668627 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:22:42.681388 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.689372 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012522 May 27 16:22:42.689958 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:22:42.704554 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-462ce6a0-f2af-40e4-82e8-cf48d060ee56 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:22:42.717051 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-462ce6a0-f2af-40e4-82e8-cf48d060ee56 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016265 May 27 16:22:42.717734 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Fri May 27 16:22:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:26:35.760580 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:35.761633 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 27 16:26:35.762052 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:26:35.925393 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_api:SELECT=6 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:36.042978 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:36.044175 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:26:36.044175 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:26:36.045428 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:36.045805 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:36.046604 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:36.047024 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:36.080889 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-01d1c8d2-3f29-429f-ace0-fd761a9639d0 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157178 May 27 16:26:36.081477 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:26:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:26:36.975351 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:36.976416 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002571 May 27 16:26:36.976836 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:26:37.175216 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:37.176382 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:26:37.176382 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:26:37.177822 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:37.178263 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:37.179116 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:37.179542 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:37.198699 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-75ec12f0-f37e-4a09-a9dd-8148e61be45a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075875 May 27 16:26:37.199254 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:26:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 16:26:48.625307 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:48.626406 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 27 16:26:48.626794 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:26:48.769999 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_cell0:SELECT=4 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:48.770813 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_cell1:SELECT=4 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:48.771495 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG dbcounter [-] [103816] Writing DB stats nova_api:SELECT=8 {{(pid=103816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:48.821469 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:48.822645 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:26:48.822645 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:26:48.823890 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:48.824340 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:48.825129 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:48.825595 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:48.853298 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-b0d54a33-e887-44f6-b072-0416cf9ed415 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087539 May 27 16:26:48.853800 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:26:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:26:49.731977 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: DEBUG nova.api.openstack.wsgi [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] Calling method '>' {{(pid=103815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:49.732996 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: INFO nova.api.openstack.requestlog [None req-c3873a55-b59b-4e3f-9cdc-603678082967 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 27 16:26:49.733423 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: [pid: 103815|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Fri May 27 16:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:26:49.928046 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG nova.api.openstack.wsgi [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] Calling method '>' {{(pid=103816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:26:49.929403 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:26:49.929403 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: warnings.warn(msg) May 27 16:26:49.930780 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:49.931293 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:49.932370 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:26:49.933007 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: DEBUG oslo_concurrency.lockutils [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:26:49.957859 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: INFO nova.api.openstack.requestlog [None req-9a29e854-16a1-4f13-8acd-838ad2cd0700 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083858 May 27 16:26:49.957859 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: [pid: 103816|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Fri May 27 16:26:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:27:49.572692 dv-cinder-840493-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 16:27:49.573240 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: Fri May 27 16:27:49 2022 - graceful shutdown triggered... May 27 16:27:49.573723 dv-cinder-840493-2-iscsi devstack@n-api.service[103815]: Gracefully killing worker 1 (pid: 103815)... May 27 16:27:49.574075 dv-cinder-840493-2-iscsi devstack@n-api.service[103816]: Gracefully killing worker 2 (pid: 103816)... May 27 16:27:50.574135 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: worker 1 buried after 1 seconds May 27 16:27:50.574135 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: worker 2 buried after 1 seconds May 27 16:27:50.574135 dv-cinder-840493-2-iscsi devstack@n-api.service[103814]: goodbye to uWSGI. May 27 16:27:50.575832 dv-cinder-840493-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 16:27:50.576408 dv-cinder-840493-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 16:27:50.579150 dv-cinder-840493-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 16:27:50.597041 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 16:27:50 2022] *** May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: nodename: dv-cinder-840493-2-iscsi May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: machine: x86_64 May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: clock source: unix May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: pcre jit disabled May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: detected number of CPU cores: 4 May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: current working directory: / May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: detected binary path: /usr/bin/uwsgi-core May 27 16:27:50.617171 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: your processes number limit is 47680 May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: your memory page size is 4096 bytes May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: detected max file descriptor number: 2048 May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: lock engine: pthread robust mutexes May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: thunder lock: enabled May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 16:27:50.618037 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 16:27:50.665097 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: Python main interpreter initialized at 0x55d09f0409c0 May 27 16:27:50.665097 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: python threads support enabled May 27 16:27:50.665097 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: your server socket listen backlog is limited to 100 connections May 27 16:27:50.665097 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: your mercy for graceful operations on workers is 90 seconds May 27 16:27:50.665570 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: mapped 403077 bytes (393 KB) for 2 cores May 27 16:27:50.665570 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: *** Operational MODE: preforking *** May 27 16:27:50.665829 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: *** uWSGI is running in multiple interpreter mode *** May 27 16:27:50.665829 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: spawned uWSGI master process (pid: 118469) May 27 16:27:50.666038 dv-cinder-840493-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 16:27:50.666663 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: spawned uWSGI worker 1 (pid: 118487, cores: 1) May 27 16:27:50.667177 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: spawned uWSGI worker 2 (pid: 118488, cores: 1) May 27 16:27:50.667465 dv-cinder-840493-2-iscsi devstack@n-api.service[118469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 16:27:51.863067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 16:27:51.866504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 16:27:52.681659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:27:52.681659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: from cryptography.utils import int_from_bytes May 27 16:27:52.682000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:27:52.682000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: from cryptography.utils import int_from_bytes May 27 16:27:52.686694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:27:52.686694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: from cryptography.utils import int_from_bytes May 27 16:27:52.687040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:27:52.687040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: from cryptography.utils import int_from_bytes May 27 16:27:55.147788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:27:55.148416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:27:55.148701 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:27:55.148946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:27:55.149206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:27:55.149621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.149951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.150277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.150600 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.150936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.151250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.151576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.151910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.152230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.152496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.152823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.153143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840493-2-iscsi {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.153495 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.154079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.154724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.154724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.154891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.155202 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.155513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.156016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.157428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.157428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.157428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.157717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.158038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.158351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.158680 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.158792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:27:55.159200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.159282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:27:55.159358 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.159596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:27:55.159710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.159994 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:27:55.160118 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840493-2-iscsi {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.160282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:27:55.160527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.160738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.160947 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.161172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.161408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.161408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.161846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.162064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.163127 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.163334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.163585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.163797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.164228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.164452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.164606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.164606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.164941 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.165144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.165320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.165320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.165672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.165864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840493-2-iscsi {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166496 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.166797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.167565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.167722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.167882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.167882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168964 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.168964 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.169258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.170844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.170996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.171775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.172930 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173081 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.173906 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174067 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840493-2-iscsi {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.174966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175247 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175550 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175550 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.175969 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176258 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.176865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177005 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177155 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.177937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.178093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.178234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.178403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.178554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.178704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.179074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.181803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.181986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182292 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.182892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183494 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.183959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.184099 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.184248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.184460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.184610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.184759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.187269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.187480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.187480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.187792 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.187943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188819 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.188967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189114 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.189899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190046 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.190890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.191023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.191857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.191995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192574 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.192909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.193135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.193252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.193391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.193391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.210585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.210870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.210962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211215 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211558 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.211937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212152 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.212981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213277 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213580 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213752 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.213935 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214294 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214558 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.214994 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215520 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215739 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.215851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.215979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.216079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.216395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216483 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.216559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.216715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.216872 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.216943 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.217060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.217179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.217576 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.217668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.217772 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.217857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.217946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.218040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.218129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.218221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.218304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.218394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.218483 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.218574 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.218656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.218750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.218894 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.219110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219183 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.219252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219337 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.219408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.219628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.219853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.219955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.220045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.220129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.220262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.220381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.220511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.220634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.220634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.220850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.220850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.221115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.221289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.221522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.221706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.221907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.221998 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.222133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.222277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.222377 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.222529 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.222624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:27:55.222715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.222846 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.222959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223405 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223693 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.223995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224347 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224876 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.224967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225058 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225142 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225316 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225426 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.225941 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226292 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.226472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.232886 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233492 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.233936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.234022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239572 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.239935 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240108 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240384 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240474 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240741 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.240973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241145 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241532 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.241954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242132 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242490 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242812 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.242951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243101 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243240 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243316 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243605 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243681 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.243997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244067 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244220 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244562 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244886 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.244964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245359 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245827 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.245980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246503 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246806 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.246958 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247336 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.247442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248104 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.248991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249614 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249685 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249753 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249821 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.249982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250347 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.250989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251065 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251370 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251506 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251580 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251737 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.251952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252101 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.252971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253119 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253262 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253403 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253403 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253562 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.253990 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254349 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.254929 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255371 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255721 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.255951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256386 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256661 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.256995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257166 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257574 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257849 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.257942 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.258999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259081 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259345 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259783 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.259949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260030 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.260978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261202 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261278 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261691 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261768 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261845 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.261997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262364 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262583 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.262949 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263490 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263826 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263896 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.263965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264563 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264638 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.264944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265019 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.265931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266149 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266512 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266591 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266891 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.266991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267411 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.267953 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268484 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.268929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.269062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.269324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273703 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273883 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.273965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274513 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.274956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275302 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.275931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276139 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276815 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276883 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.276959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277698 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.277992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278783 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.278958 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.279346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.279494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.279825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.279926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.280893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281542 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.281869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.282864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283157 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.283856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284031 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.284959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285206 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285365 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285768 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.285912 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.286853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287164 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.287957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288091 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288280 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.288996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.289961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.290907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291133 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291441 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.291838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.292994 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293093 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293649 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.293967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.294059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.294276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.294975 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295534 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.295924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296495 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296777 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.296955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297440 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.297925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298233 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298729 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.298987 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.299936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300120 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300730 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.300871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301713 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.301852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.302975 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303736 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.303911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304535 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.304993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305828 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.305963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.306889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307683 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.307996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308618 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.308991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309616 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.309888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.310762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.310913 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311459 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.311883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312345 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.312981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.313156 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.313382 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.313518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.313702 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.313842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314649 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.314964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315413 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.315904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316328 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.316962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.317946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318572 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318703 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.318885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.319930 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320245 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320555 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.320967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321298 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.321971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322475 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322615 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.322987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323269 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323435 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323575 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323746 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.323885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324211 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.324823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.325900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326073 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326205 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.326855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327175 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327689 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.327904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328179 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.328961 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329092 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329268 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.329916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.330837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.331886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.332991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333123 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.333931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334340 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334875 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.334983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335313 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335832 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.335973 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336284 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336453 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.336928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337578 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.337890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338525 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.338857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339206 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339349 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.339988 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.340996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.341221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.341406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.341666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.341808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.341985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.342125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.342547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.342685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.342874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.343956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.344899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345081 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.345874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.346837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347188 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.347979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.348937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349067 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.349879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350612 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350742 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.350870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351014 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351557 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.351888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352086 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.352964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.353104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.353353 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.353607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.353751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.353893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354031 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.354950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.355361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.355497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.355634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.355760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.355901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356582 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.356720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.357417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.357635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.357770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.357969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358317 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.358959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359279 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.359900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.360934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.361132 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.361248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.361486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.361602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.361809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.364654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.364654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.364881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.364968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.365887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366280 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366409 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.366931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.367936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368020 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368295 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368573 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368663 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.368946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.369948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370091 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370577 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.370884 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371433 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.371925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.372115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.372247 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.372474 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.373119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.373315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.373563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.373713 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.373907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.374880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375196 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.375925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.376900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377219 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377569 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.377868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.378996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379605 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.379915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380350 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.380867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.381944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.382868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.383837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.384849 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385411 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385582 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.385901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386233 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386682 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.386857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387284 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387459 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.387913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.388143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.388489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.388831 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.388980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389118 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389563 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.389875 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.390987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391265 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391574 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.391892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392033 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392344 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392517 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.392960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393483 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.393949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394254 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.394916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395341 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.395954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396262 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396711 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.396879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.397955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398130 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398436 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.398881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399670 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.399795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400149 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400338 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400796 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.400984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.401969 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402429 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.402942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403114 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.403946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404378 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.404874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.405971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.406150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.406290 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.406460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.406602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.406770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407703 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.407845 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.408934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409414 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409583 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.409892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410341 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.410951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411152 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.411929 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412580 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.412899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413081 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.413899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.414979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:27:55.415112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.415336 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.415655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.415973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.416286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.416602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.416934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.417264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.417601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.417932 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.418256 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.418580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.418902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.419219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.420119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.420608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.420839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.421165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.421509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.421838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.422163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.422487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.422825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.423155 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.423474 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.423807 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.424138 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.424489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.424807 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.425159 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.425588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.425912 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.426231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.426546 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:27:55.426790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:27:55.475853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO dbcounter [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Registered counter for database nova_api May 27 16:27:55.487391 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO dbcounter [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Registered counter for database nova_api May 27 16:27:55.496415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_db.sqlalchemy.engines [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.503961 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writer thread running {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.507234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_db.sqlalchemy.engines [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.514943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writer thread running {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.562093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.context [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6293b2d6-a723-4343-b59c-2c55f0df4078(cell1) {{(pid=118487) load_cells /opt/stack/nova/nova/context.py:464}} May 27 16:27:55.566356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:27:55.567843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:27:55.568651 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:27:55.570813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:27:55.572759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.context [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6293b2d6-a723-4343-b59c-2c55f0df4078(cell1) {{(pid=118488) load_cells /opt/stack/nova/nova/context.py:464}} May 27 16:27:55.572889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO dbcounter [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Registered counter for database nova_cell0 May 27 16:27:55.576978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO dbcounter [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Registered counter for database nova_cell1 May 27 16:27:55.577152 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:27:55.578760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:27:55.579577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:27:55.581591 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:27:55.585153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO dbcounter [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Registered counter for database nova_cell0 May 27 16:27:55.585378 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_db.sqlalchemy.engines [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.586824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_db.sqlalchemy.engines [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.587867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO dbcounter [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Registered counter for database nova_cell1 May 27 16:27:55.592904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writer thread running {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.596267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_db.sqlalchemy.engines [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.597972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_db.sqlalchemy.engines [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.598298 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writer thread running {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.603548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writer thread running {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.609452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writer thread running {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.743619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO dbcounter [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Registered counter for database nova_cell0 May 27 16:27:55.752125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_db.sqlalchemy.engines [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.757225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO dbcounter [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Registered counter for database nova_cell0 May 27 16:27:55.758306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writer thread running {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:55.766428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_db.sqlalchemy.engines [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:27:55.771689 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writer thread running {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:27:56.081960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: WARNING keystonemiddleware.auth_token [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:27:56.089283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: WARNING keystonemiddleware.auth_token [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:27:56.100981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: WARNING keystonemiddleware.auth_token [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:27:56.108991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: WARNING keystonemiddleware.auth_token [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:27:56.440348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: WARNING keystonemiddleware.auth_token [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:27:56.446309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: WARNING keystonemiddleware.auth_token [None req-fe3438ea-e8ef-4e26-bd5c-4d887bff7e89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:27:56.452312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d09f0409c0 pid: 118487 (default app) May 27 16:27:56.454896 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: WARNING keystonemiddleware.auth_token [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 16:27:56.460842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: WARNING keystonemiddleware.auth_token [None req-957e684c-2bd9-4600-a2ce-704632505044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 16:27:56.466147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d09f0409c0 pid: 118488 (default app) May 27 16:28:38.359413 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:38.363148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:38.363148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:38.363699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:39.892730 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ffdb003f-7675-44f8-83b7-0b712a17ae90 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Action: 'create', calling method: .version_select at 0x7f0e9be61c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2000498862"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:42.295487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:42.300360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:42.304984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:42.306374 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:42.435203 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ffdb003f-7675-44f8-83b7-0b712a17ae90 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.080689 May 27 16:28:42.442441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Fri May 27 16:28:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4083 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 16:28:42.448679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e2bfb665-7620-4b6e-8158-cf1ed940c905 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcb2b80>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:42.569129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e2bfb665-7620-4b6e-8158-cf1ed940c905 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 200 len: 345 microversion: 2.1 time: 0.124236 May 27 16:28:42.569983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:42 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:28:43.249568 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1841167347", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "networks": [{"uuid": "ea852da7-42d9-4ac0-9378-491c47039177"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:43.591634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-329f5f9a-74bd-4aa5-bbb8-57378be200bf tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcb2d30>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:43.616763 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] validate_networks() for [('ea852da7-42d9-4ac0-9378-491c47039177', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:28:43.773810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-329f5f9a-74bd-4aa5-bbb8-57378be200bf tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 200 len: 345 microversion: 2.1 time: 0.195119 May 27 16:28:43.778726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:43 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:44.788836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-18ee26b6-676d-42f8-bf70-a987c3ee12be tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcca310>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:45.113884 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-18ee26b6-676d-42f8-bf70-a987c3ee12be tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 200 len: 346 microversion: 2.1 time: 0.329562 May 27 16:28:45.114452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:44 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 346 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:28:45.129705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-29e3cebc-efb4-424f-a86a-55669aa3fd7e tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Action: 'create', calling method: .version_select at 0x7f0e9bcca940>, body: {"snapshot": {"volume_id": "fae0b9c9-df49-411b-977a-48c6e8042ffb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1065292590"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:45.878607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:28:45.879038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:28:45.879382 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:28:45.879950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:28:45.880587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:28:45.903278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:45.903915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:45.904855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:45.905495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:45.973314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Getting quotas for project 32666b3567c94e06a7f720c1abe2a8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:28:45.987570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Getting quotas for user a0a422ada9ab43609a7940a1df349b7b and project 32666b3567c94e06a7f720c1abe2a8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:28:46.015431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:28:46.018653 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:28:46.124709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-29e3cebc-efb4-424f-a86a-55669aa3fd7e tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.001595 May 27 16:28:46.133800 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 5/5] 10.222.0.42 () {60 vars in 1161 bytes} [Fri May 27 16:28:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:46.145971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-df8f3a9e-b3ba-4abb-9e67-659db756df53 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bccad30>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:46.277706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a545c229-821a-4c09-8e25-d692f511900f tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.999984 May 27 16:28:46.284693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 1/6] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:28:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:28:46.292246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-02930bc2-334a-4d01-a293-5c4ebeda3991 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:46.293063 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-02930bc2-334a-4d01-a293-5c4ebeda3991 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:46.383323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-df8f3a9e-b3ba-4abb-9e67-659db756df53 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.240736 May 27 16:28:46.388718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 6/7] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:46 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:46.394208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c1352ef8-19f9-4356-bfdf-7640a41b5423 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcca550>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:46.564310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c1352ef8-19f9-4356-bfdf-7640a41b5423 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.174106 May 27 16:28:46.565306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 7/8] 10.222.0.42 () {58 vars in 1139 bytes} [Fri May 27 16:28:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:46.578097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8faec40b-50b5-4181-85cb-d0be3130afe3 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcd60d0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:46.681206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8faec40b-50b5-4181-85cb-d0be3130afe3 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.105764 May 27 16:28:46.681206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:46 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:46.877151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-02930bc2-334a-4d01-a293-5c4ebeda3991 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:46.920265 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-02930bc2-334a-4d01-a293-5c4ebeda3991 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1215 microversion: 2.1 time: 0.632535 May 27 16:28:46.921007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 2/10] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:46 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1215 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:47.690590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-97c7a4eb-3b44-44ab-ba61-fe6192a9dbdb tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcb2a60>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:47.744330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-97c7a4eb-3b44-44ab-ba61-fe6192a9dbdb tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.057442 May 27 16:28:47.745504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 9/11] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:47 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:47.944566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3d67e45b-e3ec-4b2c-ac20-86facad77279 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:47.946110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3d67e45b-e3ec-4b2c-ac20-86facad77279 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:48.048328 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3d67e45b-e3ec-4b2c-ac20-86facad77279 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:48.056893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3d67e45b-e3ec-4b2c-ac20-86facad77279 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1215 microversion: 2.1 time: 0.120353 May 27 16:28:48.075145 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 3/12] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:47 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:48.758080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c21b58d9-dae6-4254-9fdc-25110d1d1d15 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bcca310>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:48.818805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c21b58d9-dae6-4254-9fdc-25110d1d1d15 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.065562 May 27 16:28:48.819686 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 10/13] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:48 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:28:49.083442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d3338ad0-91d2-49ef-874f-c82be7a7ebec tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:49.090556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d3338ad0-91d2-49ef-874f-c82be7a7ebec tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:49.265215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d3338ad0-91d2-49ef-874f-c82be7a7ebec tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:49.287465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d3338ad0-91d2-49ef-874f-c82be7a7ebec tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1215 microversion: 2.1 time: 0.215333 May 27 16:28:49.307501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 4/14] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:49 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:49.814002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5a7a363c-56a4-4cce-b3ff-3b76cab1c4bf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: .version_select at 0x7f0e9bcca820>, body: {"keypair": {"name": "tempest-keypair-978792413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFASdSe2LRjm2dgXDs+gcP+MHwbzjKTBmVxixdixthhwOMMbThIRvo3Sg2WK2myqw8nMPYI6Qs0ai8anpAXoIpUymteh23aK5TdmRV+zPrfCTtB3VPirLxWTXcoJejHQDA=="}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:49.832135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9394b74a-73db-44b7-82e6-7886d1bb4ef4 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9b41adc0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:49.964011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-5a7a363c-56a4-4cce-b3ff-3b76cab1c4bf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for project 26ab6251a87c4271b77242545ef4837f. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:28:49.980299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-5a7a363c-56a4-4cce-b3ff-3b76cab1c4bf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for user 391d41dab9294cd39d3b80d60570034e and project 26ab6251a87c4271b77242545ef4837f. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:28:50.002993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9394b74a-73db-44b7-82e6-7886d1bb4ef4 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.175678 May 27 16:28:50.004052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 5/15] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:49 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:50.213548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5a7a363c-56a4-4cce-b3ff-3b76cab1c4bf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.480339 May 27 16:28:50.221446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 11/16] 10.222.0.42 () {62 vars in 1199 bytes} [Fri May 27 16:28:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 16:28:50.313917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:50.316958 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:50.332648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:50.334842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:50.339881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:50.340770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:50.740087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:50.765189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c1aa594f-f449-46f3-9e25-d441444adb63 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1211 microversion: 2.1 time: 0.457788 May 27 16:28:50.779442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 6/17] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:50 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1211 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:51.022527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2504a539-65d0-4eae-b5ef-b092cee0f126 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc9ef70>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:51.109802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2504a539-65d0-4eae-b5ef-b092cee0f126 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 288 microversion: 2.1 time: 0.094674 May 27 16:28:51.111306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 12/18] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:51 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:51.122683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-acea28d0-46ed-47d2-9897-bc4f1e3ee13a tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9ab05a60>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:51.404606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-acea28d0-46ed-47d2-9897-bc4f1e3ee13a tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 202 len: 0 microversion: 2.1 time: 0.286550 May 27 16:28:51.414171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-306b8a9a-ac49-427e-96ba-de095b08b2c1 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc52700>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:51.414511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 7/19] 10.222.0.42 () {58 vars in 1253 bytes} [Fri May 27 16:28:51 2022] DELETE /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:28:51.455236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-306b8a9a-ac49-427e-96ba-de095b08b2c1 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.045501 May 27 16:28:51.457293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 13/20] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:51 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:51.783936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:51.786122 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:51.798371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:51.801373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:51.802223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:51.802659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:52.468252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-12d6a5a2-fdaa-45b9-ad38-79e9a58a2176 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc52dc0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:52.545110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-12d6a5a2-fdaa-45b9-ad38-79e9a58a2176 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.078806 May 27 16:28:52.547233 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 14/21] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:52 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:52.552515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:52.564071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-93c40305-93bf-4679-ad53-e82746595342 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1211 microversion: 2.1 time: 0.781567 May 27 16:28:52.564913 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 8/22] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:51 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1211 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:53.556248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-68b96ad3-9fba-4056-a5d9-fff68b0f81ba tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc52af0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:53.583877 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:53.587121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:53.598355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:53.599021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:53.602105 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:53.604632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-68b96ad3-9fba-4056-a5d9-fff68b0f81ba tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 200 len: 287 microversion: 2.1 time: 0.054475 May 27 16:28:53.606016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 15/23] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:53 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:53.612864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:54.380116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-503f543a-2a0d-47a1-b9d6-9ad2d4546c01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: .version_select at 0x7f0e9bc525e0>, body: {"keypair": {"name": "tempest-keypair-1392127834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkX6pzWYXZe2ADEk1SnreXx2GYPuLeoAuNvhL8j6+kXdsu1Dds6aliUkbew5m6Ju5Z7B74n+lQaWIwrRvmVSjU6TsNzr6YBbsdng6BdiCMEvvwhdAqtqZ+J9IYCiKEVqw=="}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:54.412375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-503f543a-2a0d-47a1-b9d6-9ad2d4546c01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:28:54.433747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-503f543a-2a0d-47a1-b9d6-9ad2d4546c01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:28:54.467685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:54.480393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b11a77ba-987a-44df-807b-7350700b9ef5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1267 microversion: 2.1 time: 0.899247 May 27 16:28:54.483277 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 9/24] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:53 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1267 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:28:54.577632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-503f543a-2a0d-47a1-b9d6-9ad2d4546c01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308827 May 27 16:28:54.578502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 16/25] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:28:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:28:54.619413 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b22d9db-9029-4020-bb36-e09c82b4adfd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9b41a0d0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:55.334439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-1b22d9db-9029-4020-bb36-e09c82b4adfd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] HTTP exception thrown: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b22d9db-9029-4020-bb36-e09c82b4adfd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Request method failure captured: May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 HTTP/1.1 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw2dYHx0kAG2kgK7x2fGwrAd8knfyeLyVQUUdsWk9IlTeJrI6j7-P8kBIo2ahbsjdubgZhu6ADMiAyIsTCXKH6DYHFDsfIi9lUVO8kpbyPIchhi7w196xRYdprkokwPSCaa6Y4ueClY7XlasNdlGUFttyWTY2_p26B1n9XHHPMYTrI May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:28:55.340608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5dd9243059c8473c873d19c3a18d3f85", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: ef7185d37eef4e48a716bbe8a8c39125 May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'a942e614-c2b7-43a1-bd39-7dec34304709'} May 27 16:28:55.341673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. (HTTP 404) (Request-ID: req-532a20a1-405c-4b86-b8f2-0a5673325d50) May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.342605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:55.343423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 16:28:55.344335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:55.345950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b22d9db-9029-4020-bb36-e09c82b4adfd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Returning 404 to user: Snapshot a942e614-c2b7-43a1-bd39-7dec34304709 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:28:55.362269 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1b22d9db-9029-4020-bb36-e09c82b4adfd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709" status: 404 len: 111 microversion: 2.1 time: 0.748200 May 27 16:28:55.367074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 10/26] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:28:54 2022] GET /compute/v2.1/os-snapshots/a942e614-c2b7-43a1-bd39-7dec34304709 => generated 111 bytes in 754 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:28:55.375151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9a86ea73-4e06-4cc5-9a82-c4556532d9d6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc52160>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:55.512378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:55.515088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:55.528398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:55.530529 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:55.533766 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:55.534367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:55.903459 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9a86ea73-4e06-4cc5-9a82-c4556532d9d6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 202 len: 0 microversion: 2.1 time: 0.534325 May 27 16:28:55.904129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:28:55 2022] DELETE /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:28:55.915242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5a548c9f-7942-47fa-8977-0032bbb4c9cd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9bc52a60>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:55.933671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:55.969577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:55.999944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e9fcb3f9-2a65-40a7-8dfb-0c45d08aba7b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1273 microversion: 2.1 time: 0.497193 May 27 16:28:56.006440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:55 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:28:56.056347 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5a548c9f-7942-47fa-8977-0032bbb4c9cd tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 200 len: 345 microversion: 2.1 time: 0.147147 May 27 16:28:56.057151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 18/29] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:55 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:28:56.238477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d503f440-72fd-4629-a69e-b7c7d30c90f8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: .version_select at 0x7f0e9aa8f790>, body: {"keypair": {"name": "tempest-keypair-1348895047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUjy7y7bh5iPpvz2ucwyhPNihwfTuyBhU5Sff/M5ZC9gNLnOOiFgEBWxV9Tpd+2u1CVpY1td/neocPxr5kKbr/9k97EMxNc42ubCWh4q/YrM6cOYLwSJGRC8rcJWrQ7FA=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:56.316671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-d503f440-72fd-4629-a69e-b7c7d30c90f8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:28:56.325705 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-d503f440-72fd-4629-a69e-b7c7d30c90f8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for user 87d41932bfa94f369103ed29d29940b3 and project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:28:56.507811 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d503f440-72fd-4629-a69e-b7c7d30c90f8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.411419 May 27 16:28:56.508889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 12/30] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:28:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:28:57.027456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:57.028392 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:57.071866 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a4566def-e94f-4bd2-a82a-15d194016770 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9ab1dee0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:57.088722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:57.094226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:57.095257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:57.095883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:57.164479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-a4566def-e94f-4bd2-a82a-15d194016770 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] HTTP exception thrown: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a4566def-e94f-4bd2-a82a-15d194016770 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Request method failure captured: May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb HTTP/1.1 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw2dYHx0kAG2kgK7x2fGwrAd8knfyeLyVQUUdsWk9IlTeJrI6j7-P8kBIo2ahbsjdubgZhu6ADMiAyIsTCXKH6DYHFDsfIi9lUVO8kpbyPIchhi7w196xRYdprkokwPSCaa6Y4ueClY7XlasNdlGUFttyWTY2_p26B1n9XHHPMYTrI May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:28:57.167326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5dd9243059c8473c873d19c3a18d3f85", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: ef7185d37eef4e48a716bbe8a8c39125 May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'fae0b9c9-df49-411b-977a-48c6e8042ffb'} May 27 16:28:57.168409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. (HTTP 404) (Request-ID: req-0114b4c5-6528-4ad6-b0f4-977c2b449152) May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.169032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:57.170176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 16:28:57.171067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.171928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.174798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a4566def-e94f-4bd2-a82a-15d194016770 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Returning 404 to user: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:28:57.183336 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a4566def-e94f-4bd2-a82a-15d194016770 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 404 len: 109 microversion: 2.1 time: 0.116926 May 27 16:28:57.186018 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 13/31] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:57 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:28:57.207372 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3fa54909-136a-4e7b-9387-14c55ab5866b tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9c642160>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:57.305876 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-3fa54909-136a-4e7b-9387-14c55ab5866b tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] HTTP exception thrown: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3fa54909-136a-4e7b-9387-14c55ab5866b tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Request method failure captured: May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb HTTP/1.1 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw2dYHx0kAG2kgK7x2fGwrAd8knfyeLyVQUUdsWk9IlTeJrI6j7-P8kBIo2ahbsjdubgZhu6ADMiAyIsTCXKH6DYHFDsfIi9lUVO8kpbyPIchhi7w196xRYdprkokwPSCaa6Y4ueClY7XlasNdlGUFttyWTY2_p26B1n9XHHPMYTrI May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:28:57.308621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5dd9243059c8473c873d19c3a18d3f85", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: ef7185d37eef4e48a716bbe8a8c39125 May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'fae0b9c9-df49-411b-977a-48c6e8042ffb'} May 27 16:28:57.309778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. (HTTP 404) (Request-ID: req-fd6ffc9a-b468-4500-8c73-deedd989f704) May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.310438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:28:57.311341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 16:28:57.312214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3fa54909-136a-4e7b-9387-14c55ab5866b tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Returning 404 to user: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3fa54909-136a-4e7b-9387-14c55ab5866b tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 404 len: 109 microversion: 2.1 time: 0.121593 May 27 16:28:57.321580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 14/32] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:28:57 2022] DELETE /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:28:57.331686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-82525a4d-c64e-45cf-a22a-17f2dd0114e6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Calling method '.version_select at 0x7f0e9aa34040>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:57.424287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-82525a4d-c64e-45cf-a22a-17f2dd0114e6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] HTTP exception thrown: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-82525a4d-c64e-45cf-a22a-17f2dd0114e6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Request method failure captured: May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb HTTP/1.1 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw2dYHx0kAG2kgK7x2fGwrAd8knfyeLyVQUUdsWk9IlTeJrI6j7-P8kBIo2ahbsjdubgZhu6ADMiAyIsTCXKH6DYHFDsfIi9lUVO8kpbyPIchhi7w196xRYdprkokwPSCaa6Y4ueClY7XlasNdlGUFttyWTY2_p26B1n9XHHPMYTrI May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:28:57.426545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5dd9243059c8473c873d19c3a18d3f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5dd9243059c8473c873d19c3a18d3f85", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 5dd9243059c8473c873d19c3a18d3f85 May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1411371880 May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: ef7185d37eef4e48a716bbe8a8c39125 May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1411371880-project May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'fae0b9c9-df49-411b-977a-48c6e8042ffb'} May 27 16:28:57.427837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. (HTTP 404) (Request-ID: req-73147d52-3779-498f-91da-bd367f51ef1c) May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.428633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:28:57.430397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 16:28:57.431540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:28:57.432659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-82525a4d-c64e-45cf-a22a-17f2dd0114e6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] Returning 404 to user: Volume fae0b9c9-df49-411b-977a-48c6e8042ffb could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:28:57.437932 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-82525a4d-c64e-45cf-a22a-17f2dd0114e6 tempest-VolumesSnapshotsTestJSON-1411371880 tempest-VolumesSnapshotsTestJSON-1411371880-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb" status: 404 len: 109 microversion: 2.1 time: 0.106935 May 27 16:28:57.437932 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 15/33] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:28:57 2022] GET /compute/v2.1/os-volumes/fae0b9c9-df49-411b-977a-48c6e8042ffb => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:28:58.320623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:28:58.344253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7b26611e-5aa6-4141-ad46-eaeedbdf423e tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 1.323926 May 27 16:28:58.446061 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 19/34] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:57 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:28:59.469500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:28:59.472185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:28:59.496891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:59.497420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:59.503187 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:28:59.504341 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:28:59.688365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-113575254", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:28:59.855856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] validate_networks() for [('4b4aa0c1-80e2-4655-bb67-93c62e39df1f', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:29:01.780092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:01.788453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-deb6cfd4-63d8-48b7-a8f0-32b6cc523a21 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 2.333878 May 27 16:29:01.795149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:28:59 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:01.813329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-42507026", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55100481-4365-412d-b292-c811a999e4c5"}], "security_groups": [{"name": "tempest-securitygroup--1722604779"}], "key_name": "tempest-keypair-978792413", "user_data": "}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:02.299302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] validate_networks() for [('55100481-4365-412d-b292-c811a999e4c5', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:29:03.319171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:29:03.319780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:29:03.321977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:29:03.326015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:29:03.326015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:29:03.361765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:03.362278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:03.365792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:03.366240 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:03.435336 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:29:03.446154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for user cf3e0adc32814585b57bf9f884840fc9 and project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:29:03.482695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:29:03.488992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:29:03.706807 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-652a0a27-b769-41bb-963e-ded5f4bc64af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.445923 May 27 16:29:03.707473 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:28:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:29:04.227043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-f1f5638c-3896-4dd4-8e5e-7b52c49b0399 req-1ad3502b-d941-454b-95c0-72d464511187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6667842-dd11-4097-a37f-2098f2a79c9d", "tag": "828e7b2d-5a1e-4b47-a5bb-001643444ef5"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:04.256253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-f1f5638c-3896-4dd4-8e5e-7b52c49b0399 req-1ad3502b-d941-454b-95c0-72d464511187 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.257037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-f1f5638c-3896-4dd4-8e5e-7b52c49b0399 req-1ad3502b-d941-454b-95c0-72d464511187 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.357308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-f1f5638c-3896-4dd4-8e5e-7b52c49b0399 req-1ad3502b-d941-454b-95c0-72d464511187 service nova] Creating event network-changed:828e7b2d-5a1e-4b47-a5bb-001643444ef5 for instance a6667842-dd11-4097-a37f-2098f2a79c9d on hv-cinder-84049 May 27 16:29:04.363320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-f1f5638c-3896-4dd4-8e5e-7b52c49b0399 req-1ad3502b-d941-454b-95c0-72d464511187 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 16:29:04.364570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.368100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.368100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.368100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.426985 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.compute.rpcapi [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 16:29:04.428596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] Releasing lock "compute-rpcapi-router" {{(pid=118488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 16:29:04.449237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-419dac45-3f4c-4104-9bca-d88bc94890dc None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.729089 May 27 16:29:04.450766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=8 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:04.452792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 17/37] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:04.463173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:04.464505 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:04.544588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.545071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.553021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.554314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.941953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:29:04.942692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:29:04.943256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:29:04.943684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:29:04.944107 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:29:04.962105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.962542 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:04.964104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:04.964564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:05.084002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for project 26ab6251a87c4271b77242545ef4837f. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:29:05.109847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for user 391d41dab9294cd39d3b80d60570034e and project 26ab6251a87c4271b77242545ef4837f. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:29:05.142536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:29:05.148792 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:29:05.157255 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:05.193995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a75b29d5-9bab-490c-bd38-9917f7460e39 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.739712 May 27 16:29:05.194616 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 18/38] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:04 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:05.227251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-64aa8de5-8899-4535-864f-8964496e20eb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:05.232640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-64aa8de5-8899-4535-864f-8964496e20eb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:05.436675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-64aa8de5-8899-4535-864f-8964496e20eb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:05.442905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-64aa8de5-8899-4535-864f-8964496e20eb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1221 microversion: 2.1 time: 0.246188 May 27 16:29:05.443524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:05 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1221 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:05.576077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-70233a4c-f00b-4918-9b12-32f42be0da4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.774294 May 27 16:29:05.579778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 21/40] 10.222.0.42 () {62 vars in 1187 bytes} [Fri May 27 16:29:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 3777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 16:29:05.590924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:05.592349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:05.896159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-275889729", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:06.082675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] validate_networks() for [('4b4aa0c1-80e2-4655-bb67-93c62e39df1f', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:29:06.230754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:06.242605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:06.244230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:06.254865 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-46984434-4f24-419b-b983-d796d7b66ba7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1279 microversion: 2.20 time: 0.669838 May 27 16:29:06.255720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:05 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1279 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:06.265808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:06.266824 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:06.283821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:06.284783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:06.286004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:06.292349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:06.656257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:06.672076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-30fbb251-fe50-49bc-b991-85f812c5b1b8 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.414728 May 27 16:29:06.682808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:06 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:07.274593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:07.275447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:07.462200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:07.485767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:07.501914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:07.501914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6354189d-e46b-4a1a-9543-6e32eeafb3c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1279 microversion: 2.20 time: 0.220942 May 27 16:29:07.501914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:07 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:07.516236 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1061023354", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6206a18c-fdfb-4556-905d-212faa509374"}], "security_groups": [{"name": "tempest-securitygroup--1622158868"}], "key_name": "tempest-keypair-1392127834", "user_data": "}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:07.796754 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:29:07.797797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:29:07.798492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:29:07.799102 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:29:07.799708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:29:07.815441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:07.816401 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:07.817879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:07.818965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:07.856368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] validate_networks() for [('6206a18c-fdfb-4556-905d-212faa509374', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:29:07.875094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:29:07.897122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for user cf3e0adc32814585b57bf9f884840fc9 and project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:29:07.933334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:29:07.933334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:29:08.178387 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-98c44cc7-e80d-434b-ab8a-73d6274798c7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.290169 May 27 16:29:08.189707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:29:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:29:08.204769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:08.210249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:08.237649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:08.238368 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:08.250216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:08.253695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:08.818025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:08.829191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3d33be9d-49df-459f-a7b0-bd540e6c8b55 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.638085 May 27 16:29:08.829824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 23/45] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:08 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:08.834614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1da24d08-abdc-403c-bb0f-0739469ac1f6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:08.835235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1da24d08-abdc-403c-bb0f-0739469ac1f6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:08.944460 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1da24d08-abdc-403c-bb0f-0739469ac1f6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:08.985024 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1da24d08-abdc-403c-bb0f-0739469ac1f6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1221 microversion: 2.1 time: 0.149882 May 27 16:29:08.985866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 24/46] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:08 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:09.000700 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:09.001328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:09.012518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:09.029992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:09.033989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:09.034626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:09.286953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:09.307317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:09.308975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:09.310195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-283b325c-668c-4bf1-ab4e-da46f691fe5c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1331 microversion: 2.20 time: 0.323048 May 27 16:29:09.318291 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 25/47] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:08 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:09.362406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:29:09.362969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:29:09.363303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:29:09.365323 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:29:09.365323 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:29:09.391002 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:09.391463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:09.392303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:09.392755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:09.401363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-750942768", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19f13b5c-dd0c-4771-8c9a-15d583cfbfcd"}], "security_groups": [{"name": "tempest-securitygroup--320430079"}], "key_name": "tempest-keypair-1348895047", "user_data": "}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:09.445916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:29:09.455309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:29:09.471694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:29:09.478331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:29:09.613760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:09.702263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] validate_networks() for [('19f13b5c-dd0c-4771-8c9a-15d583cfbfcd', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:29:09.800571 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-342017cf-b79a-4073-b7b3-cabe8b236671 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.306916 May 27 16:29:09.801612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 23/48] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:29:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:29:09.828262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6eabbd05-a979-4db5-9b06-ba78b400eaf7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:09.832571 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6eabbd05-a979-4db5-9b06-ba78b400eaf7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:10.072299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6eabbd05-a979-4db5-9b06-ba78b400eaf7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:10.082455 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6eabbd05-a979-4db5-9b06-ba78b400eaf7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1242 microversion: 2.1 time: 0.273850 May 27 16:29:10.085515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 24/49] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:09 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:10.092722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:10.100213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:10.105879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:10.107280 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:10.110011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:10.111156 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:10.984857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:10.995916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fa62788b-f753-47cd-8853-4566044f2f64 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.909097 May 27 16:29:10.998529 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:10 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:11.005087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:11.010451 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:11.028157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.038593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.049497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.050285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.168031 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.176664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-613954cf-cee1-41ce-ac69-eaacbe21bbcd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1217 microversion: 2.1 time: 0.175358 May 27 16:29:11.190446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:11 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:11.204770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:11.205806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:11.224461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.224461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.224461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.225386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.434671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:29:11.435197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:29:11.435637 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:29:11.436122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:29:11.436613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:29:11.454653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.455602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.456564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:11.457146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:11.490846 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.499910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.504296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.506196 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c9e96c67-d7af-41c5-a4f0-728851a1c078 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1337 microversion: 2.20 time: 0.314544 May 27 16:29:11.510175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:11 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1337 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:11.511834 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65695ff8-0c84-4263-ab94-e851c396ee4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:11.512645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65695ff8-0c84-4263-ab94-e851c396ee4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:11.519681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:29:11.535276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for user 87d41932bfa94f369103ed29d29940b3 and project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:29:11.568496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:29:11.570707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:29:11.584798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65695ff8-0c84-4263-ab94-e851c396ee4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.592528 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65695ff8-0c84-4263-ab94-e851c396ee4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1242 microversion: 2.1 time: 0.084529 May 27 16:29:11.615897 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:11 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:11.752575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-77e2ffb6-7421-4d50-b297-2c1dd686f2c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.396042 May 27 16:29:11.753240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 26/54] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:29:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:29:11.765672 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ebed4fa6-ed27-4c1d-b640-a5753235c6aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:11.766333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ebed4fa6-ed27-4c1d-b640-a5753235c6aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:11.846535 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ebed4fa6-ed27-4c1d-b640-a5753235c6aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:11.860251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ebed4fa6-ed27-4c1d-b640-a5753235c6aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1237 microversion: 2.1 time: 0.098986 May 27 16:29:11.861399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 29/55] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:11 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:12.025213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:12.026119 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:12.048454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.049036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:12.065650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.066113 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:12.209909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:12.214838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:12.236500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.238966 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:12.240917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.241611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:12.922614 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:12.944216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-92488781-de40-493d-97fb-ea7e8401f930 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1273 microversion: 2.1 time: 0.740479 May 27 16:29:12.954977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:12 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:12.969594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:12.972046 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:12.984508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.985963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:12.986773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:12.987404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:13.084190 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.097908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.101917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.106349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8de0bab0-101d-4fcb-82db-2ef50320dc4c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1337 microversion: 2.20 time: 0.149445 May 27 16:29:13.107050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 31/57] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:12 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1337 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:13.113564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:13.114840 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:13.135032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:13.136109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:13.137004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:13.140793 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:13.143447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.154904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-68fd8bc3-15b1-43f0-a581-152b9b859313 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 1.142606 May 27 16:29:13.156136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 27/58] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:12 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:13.162779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e77ba05a-5335-43ca-b8ef-796a831996db tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:13.163593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e77ba05a-5335-43ca-b8ef-796a831996db tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:13.263868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e77ba05a-5335-43ca-b8ef-796a831996db tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.273393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e77ba05a-5335-43ca-b8ef-796a831996db tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1237 microversion: 2.1 time: 0.115710 May 27 16:29:13.274013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:13 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:13.302095 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:13.324600 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ad3dff9f-1227-4ec2-b2e4-5618588da968 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1294 microversion: 2.1 time: 0.215203 May 27 16:29:13.335297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 32/60] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:13 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:13.963486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:13.964101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:13.971519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:13.971979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:13.972767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:13.973213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.072538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.080801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-78abf4a0-13e8-46db-9d48-29c199d13183 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1279 microversion: 2.1 time: 0.121439 May 27 16:29:14.091771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 29/61] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:13 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:14.125199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:14.142315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:14.142315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.142315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.142315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.142800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.142800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=83 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:14.176880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:14.178437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:14.191576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.192468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.193287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.194351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.270965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.282440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.283946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.285079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-caf0d614-7284-441c-874a-b480b146945e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1337 microversion: 2.20 time: 0.164741 May 27 16:29:14.288599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 33/62] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:14 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:14.293802 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:14.298121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:14.315942 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.317111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.318173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.318781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.418891 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.445810 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a65a7706-6bcc-44cb-99c0-ae972d49204c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1241 microversion: 2.1 time: 0.142383 May 27 16:29:14.446639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 34/63] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:14 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:14.453313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:14.454089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:14.461148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.463182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.464494 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.465213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.506901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.514388 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e9072f79-889d-447d-8c13-cedde8466e58 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.344938 May 27 16:29:14.515714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:14 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:14.593070 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:14.612218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-378a65d6-a4c2-412e-8360-5819ce6f8557 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1294 microversion: 2.1 time: 0.152381 May 27 16:29:14.623267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:14 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:14.854884 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-c76207db-2018-4e98-8868-3bf2b7182d15 req-53c93721-9478-4f93-b815-0b138937742a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc97e34-9888-4c3d-9ea1-226e97c009c9", "tag": "8f129cf8-d17c-49bd-bb15-e74ecf6db21d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:14.879277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:14.888172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c76207db-2018-4e98-8868-3bf2b7182d15 req-53c93721-9478-4f93-b815-0b138937742a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.889063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c76207db-2018-4e98-8868-3bf2b7182d15 req-53c93721-9478-4f93-b815-0b138937742a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.914659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-c76207db-2018-4e98-8868-3bf2b7182d15 req-53c93721-9478-4f93-b815-0b138937742a service nova] Creating event network-changed:8f129cf8-d17c-49bd-bb15-e74ecf6db21d for instance edc97e34-9888-4c3d-9ea1-226e97c009c9 on hv-cinder-84049 May 27 16:29:14.918212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c76207db-2018-4e98-8868-3bf2b7182d15 req-53c93721-9478-4f93-b815-0b138937742a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 16:29:14.921630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.922317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.923534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:14.924176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:14.950951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.compute.rpcapi [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 16:29:14.951855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] Releasing lock "compute-rpcapi-router" {{(pid=118487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 16:29:14.988166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-13f33555-3691-4ce0-9d82-fd3c76df335b None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138784 May 27 16:29:14.989240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 31/66] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:29:15.100592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:15.102264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:15.120858 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.123550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.124613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.129086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.304491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:15.305894 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:15.317576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.318040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.318882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.319263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.617037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:15.629755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-07355f64-c134-4222-ab53-3077728d708f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.534824 May 27 16:29:15.639686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:15 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:15.639686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:15.640011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:15.655175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.656024 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.656839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.657288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.668379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:15.683891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:15.687362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:15.688672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b45060fe-2261-4101-acbc-c507a75ad78b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.388625 May 27 16:29:15.690031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 32/68] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:15 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:15.695750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:15.696447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:15.703868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.704802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.705635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.706269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.756312 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:15.768427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-08f95721-1991-4f3e-bcf7-40878d105ecb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1233 microversion: 2.1 time: 0.134584 May 27 16:29:15.768427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 37/69] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:15 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1233 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:15.773151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:15.774388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:15.784381 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.784835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:15.785642 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:15.786385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:16.000298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:16.007921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e4613276-7b26-44fa-ad5c-3376022f33f6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1312 microversion: 2.1 time: 0.239809 May 27 16:29:16.016477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 38/70] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:15 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:16.069273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:16.077229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bc93ef8f-a735-4821-824b-cb49bfe8398d tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.386138 May 27 16:29:16.077842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 33/71] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:15 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:16.647150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:16.649521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:16.664220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:16.664220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:16.665609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:16.666399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:16.708084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:16.708823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:16.723221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:16.733923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:16.735129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:16.735797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:16.914214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:16.938004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b5c769ed-aeb9-4263-89ab-39b527352932 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.294553 May 27 16:29:16.938707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:16 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:16.971080 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:16.973011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:17.002648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.002750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.002750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.002750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.002750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.014494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.024190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.030652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-556c27ca-c2e9-409d-ada1-38cf830a2e3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.321319 May 27 16:29:17.034267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 34/73] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:16 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:17.053168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:17.057875 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:17.070731 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.071543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.073977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.074668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.247498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.263191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7eea80b5-575d-4c25-8ca8-794a113e8d77 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1289 microversion: 2.1 time: 0.323127 May 27 16:29:17.264509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 40/74] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:16 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1289 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:17.277873 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.282979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:17.282979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:17.287627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f5e4428a-53e2-4a35-b19a-16eff9dfa5ea tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1300 microversion: 2.1 time: 0.252264 May 27 16:29:17.288521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 35/75] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:17 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:17.292035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.292699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.295089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.295688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.658166 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:17.672577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f4e3e9e6-77dc-44ee-a675-1721288d3e32 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.404524 May 27 16:29:17.674023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:17 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:17.816434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-1c6c2dbe-0d46-4bc7-a4e9-05519ffff5ce req-b579f920-8aa0-4b78-bfa1-fcb38a17f9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:17.831043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-1c6c2dbe-0d46-4bc7-a4e9-05519ffff5ce req-b579f920-8aa0-4b78-bfa1-fcb38a17f9a9 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.832098 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-1c6c2dbe-0d46-4bc7-a4e9-05519ffff5ce req-b579f920-8aa0-4b78-bfa1-fcb38a17f9a9 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.872941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-1c6c2dbe-0d46-4bc7-a4e9-05519ffff5ce req-b579f920-8aa0-4b78-bfa1-fcb38a17f9a9 service nova] Creating event network-changed:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:29:17.886724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-1c6c2dbe-0d46-4bc7-a4e9-05519ffff5ce req-b579f920-8aa0-4b78-bfa1-fcb38a17f9a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503011 May 27 16:29:17.889456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 36/77] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:29:17.957211 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:17.967180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:17.972491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.977464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:17.979733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:17.986445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.053094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:18.054044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:18.068676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.069407 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.070432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.072476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.252252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.268028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3b3e914d-7e3d-4271-a5dd-0fcb413077a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.315770 May 27 16:29:18.269026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 42/78] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:17 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:18.280624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:18.281654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:18.294704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.296387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.301545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.302653 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.459639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.476995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a079077f-34bb-4cee-bd67-ebe06283d292 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1295 microversion: 2.1 time: 0.199230 May 27 16:29:18.477777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:18 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:18.500519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:18.504275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:18.520885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.521696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.523681 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.524366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.552022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.578587 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.581038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.582556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-13e18aa7-674b-495c-96cb-ca521ea3b802 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.534167 May 27 16:29:18.583432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 37/80] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:18 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:18.612880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.639161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-411b3e73-b675-483a-8f07-1aab0dcb9988 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1300 microversion: 2.1 time: 0.158700 May 27 16:29:18.653712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 44/81] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:18 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:18.691976 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:18.693003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:18.710328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.711071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.788673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:18.788673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:18.905790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:18.913749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4bd05e98-dc72-4852-a0e9-9787f31f76cc tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.227580 May 27 16:29:18.914339 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 38/82] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:18 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:19.286875 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:19.286875 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:19.292396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.292871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.293677 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.294108 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.423656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:19.441968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:19.450295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bbb40589-dbe6-459a-8863-b2f2c829a67b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.169019 May 27 16:29:19.450948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 45/83] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:19 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:19.497862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:19.498479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:19.504570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.505021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.505825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.506266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.606284 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:19.609068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:19.609857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:19.617493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f36ab49c-dac6-4e50-90f5-654d68f142e8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1295 microversion: 2.1 time: 0.123590 May 27 16:29:19.618391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 39/84] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:19 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:19.626495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.629693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.629693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.629693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.660898 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:19.661835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:19.670939 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.671606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.672612 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:19.673181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:19.746962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=97 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:20.194147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.202598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cc3486ba-938d-429d-b376-2e1dc9c786cd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.546816 May 27 16:29:20.205049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 40/85] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:19 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:20.215480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.216527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-0f45b2f7-0b16-43e8-a31c-4f36ba4364b7 req-6c861029-3437-4bfe-885d-17e0c517f054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a376bd1-2163-4333-a7a2-978057e231c5", "tag": "5e118c26-5265-4811-94b8-60efa598d923"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:20.229997 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0f45b2f7-0b16-43e8-a31c-4f36ba4364b7 req-6c861029-3437-4bfe-885d-17e0c517f054 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.230705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0f45b2f7-0b16-43e8-a31c-4f36ba4364b7 req-6c861029-3437-4bfe-885d-17e0c517f054 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.231051 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.233923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.235407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b26b3bb4-bd6a-4b14-8243-8fa70c528c34 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.631879 May 27 16:29:20.236490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 46/86] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:19 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:20.248525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:20.250161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:20.255205 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-0f45b2f7-0b16-43e8-a31c-4f36ba4364b7 req-6c861029-3437-4bfe-885d-17e0c517f054 service nova] Creating event network-changed:5e118c26-5265-4811-94b8-60efa598d923 for instance 8a376bd1-2163-4333-a7a2-978057e231c5 on hv-cinder-84049 May 27 16:29:20.259174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.260598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.262138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-0f45b2f7-0b16-43e8-a31c-4f36ba4364b7 req-6c861029-3437-4bfe-885d-17e0c517f054 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055472 May 27 16:29:20.263178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 41/87] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:20.263987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.264611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.423458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-6965eaed-a3ce-43f4-87aa-929df2feed2c req-c58e15ff-5ec2-4297-b1f1-b1a0b0d08f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6667842-dd11-4097-a37f-2098f2a79c9d", "name": "network-vif-plugged", "status": "completed", "tag": "828e7b2d-5a1e-4b47-a5bb-001643444ef5"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:20.433762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-6965eaed-a3ce-43f4-87aa-929df2feed2c req-c58e15ff-5ec2-4297-b1f1-b1a0b0d08f29 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.434209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-6965eaed-a3ce-43f4-87aa-929df2feed2c req-c58e15ff-5ec2-4297-b1f1-b1a0b0d08f29 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.447244 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-6965eaed-a3ce-43f4-87aa-929df2feed2c req-c58e15ff-5ec2-4297-b1f1-b1a0b0d08f29 service nova] Creating event network-vif-plugged:828e7b2d-5a1e-4b47-a5bb-001643444ef5 for instance a6667842-dd11-4097-a37f-2098f2a79c9d on hv-cinder-84049 May 27 16:29:20.454600 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-6965eaed-a3ce-43f4-87aa-929df2feed2c req-c58e15ff-5ec2-4297-b1f1-b1a0b0d08f29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188942 May 27 16:29:20.460999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 42/88] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:20.471794 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:20.472504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:20.481221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.482008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.483036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.483609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.745798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.753831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.756628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d79dc92b-2a2c-4047-acf2-65a48792b1ba tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.518889 May 27 16:29:20.757413 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 47/89] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:20 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:20.763385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-989d9a3e-eae3-4497-99e6-eb9bdf8f9e0f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.299079 May 27 16:29:20.764376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 43/90] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:20 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:20.772650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:20.773267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:20.784156 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.784612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.789519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:20.789519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:20.935995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:20.949307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e81637a1-08a8-4c2d-940e-9bbc7b0ce6c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.180043 May 27 16:29:20.950541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 48/91] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:20 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:21.218764 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:21.219377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:21.225533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.226017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.226787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.227226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.255338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:21.256155 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:21.267250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.267701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.268461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.268920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.446975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.449853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.452233 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:21.455025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3219e96a-f57a-4eb2-9061-8b26a7fcea53 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.240068 May 27 16:29:21.455633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:21 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:21.458891 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.460499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.461707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e5a88a35-d719-4fbd-a960-afc5e8f79082 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.210329 May 27 16:29:21.463524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 49/93] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:21 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:21.782263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:21.783039 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:21.784588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:21.785201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:21.789102 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.789591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.790360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.790796 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.791359 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.792524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.793657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:21.794103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:21.858628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=40 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:21.990282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.993400 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:21.997859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2a1fa3ab-b5cd-4444-826d-825fa00b1ac9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.219584 May 27 16:29:21.998440 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 45/94] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:21 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:22.002137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-44e121df-66be-45f2-9a96-44efd789a1cd tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.221632 May 27 16:29:22.002780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 50/95] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:21 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:22.004041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:22.004041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:22.009594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.010046 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.010872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.011313 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.139182 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:22.146780 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-49cb9912-f36f-46e4-8d4b-34a1c27257bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.147390 May 27 16:29:22.147412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 46/96] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:21 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:22.471952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:22.472556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:22.481422 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.481907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.482682 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:22.483111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.483111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.483305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:22.493634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.493634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.493634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:22.493634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:22.781418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:22.790655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:22.794820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:22.794820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3e09e6fd-8c3d-4958-8540-207511e5af68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.316405 May 27 16:29:22.800439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 47/97] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:22 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:22.802434 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:22.811257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-93c6dcbf-e1a2-4e06-9b2d-b937e7265c3c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.342878 May 27 16:29:22.812104 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 51/98] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:22 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:23.021375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:23.025543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:23.026952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:23.028938 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:23.043416 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.044042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.045395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.046068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.055207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.056688 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.057287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.058215 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.268627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=22 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:23.272301 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:23.284015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:23.288950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cd76d85a-dd8f-4de4-950e-ca56d3f88c15 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.269428 May 27 16:29:23.289799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:23 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:23.293445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-506e6288-1062-44ca-a058-d5dcd48bca5b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.277551 May 27 16:29:23.303863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 52/100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:23 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:23.303975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:23.303975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:23.309814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.310259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.311025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.311464 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.455167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:23.462919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9d65cc52-870d-4501-bc5e-299fdb4fd8d8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.163983 May 27 16:29:23.463882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:23 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:23.813303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:23.813945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:23.820637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.821133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.822086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.822463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.830658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:23.831300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:23.845312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.846034 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:23.847074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:23.847674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.116142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.129724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.131448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.132586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0909ea64-639a-472b-afb3-546dadaee838 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.323700 May 27 16:29:24.156230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 53/102] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:23 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:24.165278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-9e92a604-6c04-4df8-86fb-e40807307ac7 req-1cd84599-1d2f-42b8-b9cf-50b871f727f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3034be98-8230-4ba1-bfd9-cb4e4cf776af", "tag": "41c308ca-1a37-4303-834e-73089831b6de"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:24.179235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-9e92a604-6c04-4df8-86fb-e40807307ac7 req-1cd84599-1d2f-42b8-b9cf-50b871f727f6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.184808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-9e92a604-6c04-4df8-86fb-e40807307ac7 req-1cd84599-1d2f-42b8-b9cf-50b871f727f6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.207974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.217905 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8024c2a0-1ce2-4521-aed1-121e543537bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.393031 May 27 16:29:24.220954 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-9e92a604-6c04-4df8-86fb-e40807307ac7 req-1cd84599-1d2f-42b8-b9cf-50b871f727f6 service nova] Creating event network-changed:41c308ca-1a37-4303-834e-73089831b6de for instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af on hv-cinder-84049 May 27 16:29:24.234895 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 50/103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:23 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:24.236900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-9e92a604-6c04-4df8-86fb-e40807307ac7 req-1cd84599-1d2f-42b8-b9cf-50b871f727f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078928 May 27 16:29:24.238178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 54/104] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:24.315764 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:24.315921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:24.316461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:24.316684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:24.324586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.325187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.326165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.326747 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.328311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.331225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.332211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.334570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.602910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.606643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.610816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-92cf7979-3b39-4d98-991f-f5c92474f415 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.303037 May 27 16:29:24.611392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 55/105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:24 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:24.613991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f524c109-0386-471e-8138-df189629c9b4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.312114 May 27 16:29:24.614552 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 51/106] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:24 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:24.615859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:24.616634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:24.622791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.623242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.624006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:24.624443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:24.752561 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:24.762017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-caec09d3-6ab7-44c2-90fb-4578a44b1c0e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.148121 May 27 16:29:24.763181 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 56/107] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:24 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:25.163475 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:25.164088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:25.165952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=8 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:25.171402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.171932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.172610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.173106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.241874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:25.243259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:25.250454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.251001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.251841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.252404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.335584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.344518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.346370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.347760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e16ef5bf-61c3-42e7-8b20-04acd0f6d24d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.188215 May 27 16:29:25.348452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 52/108] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:25 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:25.404671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.412162 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6ea8813f-7062-4660-8360-6ae1d15f2cd5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.174376 May 27 16:29:25.412738 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 57/109] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:25 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:25.627736 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:25.628450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:25.631435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:25.632331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:25.634618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.635070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.635838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.636441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.638646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.639095 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.639849 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.640284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.907400 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.913807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:25.915904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f2ee4e98-c526-4c03-a7e4-0315e85713af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.288244 May 27 16:29:25.925421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0ce4a81c-3b17-498c-b1da-0377e1cdf175 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.301128 May 27 16:29:25.926232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 53/111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:25 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:25.927869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 58/111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:25 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:25.932586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:25.933609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:25.940276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.940722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:25.941986 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:25.942451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.129072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:26.137384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6ead3ea4-8cbf-4958-a6e7-cdc650c51968 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.209846 May 27 16:29:26.137970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 54/112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:25 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:26.367319 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:26.367935 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:26.375125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.375580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.376351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.376791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.435846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:26.435846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:26.442246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.442918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.443774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.444223 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.552368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:26.562130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:26.563675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:26.564806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fd5ece33-4fa7-42d4-baa1-177b9f636c75 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.201395 May 27 16:29:26.567705 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 59/113] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:26 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:26.573327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-3cb94d39-34ad-4431-ab67-7f1d00a470f4 req-bd009259-daf2-497a-810c-4d13e8ae69e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5220d569-8535-429a-bfff-fa0955dec2c0", "tag": "61d181d0-5525-4601-81ec-69cc30f5255c"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:26.581948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-3cb94d39-34ad-4431-ab67-7f1d00a470f4 req-bd009259-daf2-497a-810c-4d13e8ae69e6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.585016 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-3cb94d39-34ad-4431-ab67-7f1d00a470f4 req-bd009259-daf2-497a-810c-4d13e8ae69e6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.596485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-3cb94d39-34ad-4431-ab67-7f1d00a470f4 req-bd009259-daf2-497a-810c-4d13e8ae69e6 service nova] Creating event network-changed:61d181d0-5525-4601-81ec-69cc30f5255c for instance 5220d569-8535-429a-bfff-fa0955dec2c0 on hv-cinder-84049 May 27 16:29:26.601550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-3cb94d39-34ad-4431-ab67-7f1d00a470f4 req-bd009259-daf2-497a-810c-4d13e8ae69e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034615 May 27 16:29:26.602553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 60/114] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:26.607344 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:26.615514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-99d8bbee-cc2a-458b-962b-ef7f825810d4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.189150 May 27 16:29:26.616010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 55/115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:26 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:26.934213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:26.934904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:26.943299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.943473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:26.943568 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.943701 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:26.943792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.943792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.949497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.950010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:26.950820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:26.951260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.204947 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:27.209190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:27.212943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a8d88900-bcd8-462d-985b-be6b38633fc9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.282876 May 27 16:29:27.213724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:26 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:27.216858 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ef681f6b-1633-4a0a-87aa-24b863bc6946 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.278451 May 27 16:29:27.218269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 56/117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:26 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:27.223174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:27.223174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:27.226542 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.226997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.227767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.228306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.397537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:27.406598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c083ef60-fc01-40ef-97aa-68e95b22b5de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.191423 May 27 16:29:27.407499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:27 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:27.583240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:27.583929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:27.593126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.593878 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.596607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.597150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.634699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:27.636334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:27.646349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.646876 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:27.647773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:27.648435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.009313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.012323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.017169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a33948ff-9ce5-41fb-89b5-84a552bf21c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.388101 May 27 16:29:28.017795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 63/119] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:27 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:28.023809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.025639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.027623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a92dfe4c-f646-43df-af13-1d393fb68da9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.448167 May 27 16:29:28.033637 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 57/120] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:27 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:28.230593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:28.231463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:28.236200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:28.237208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:28.237680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.238135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.238904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.239514 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.243910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.244439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.246059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.246825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.251446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:28.439012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.446112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.446451 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8a401cfc-3e5e-4fe5-8113-2e54a9e24965 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.219838 May 27 16:29:28.447025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 64/121] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:28 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:28.454972 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-15ab7edb-b251-4868-b6b7-23dafdff0853 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.222462 May 27 16:29:28.456549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 58/122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:28 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:28.459880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:28.460502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:28.467035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.467507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.468299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:28.468729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:28.602823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:28.611222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-19a81556-0074-4ba8-85db-6a8a53c56715 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.154951 May 27 16:29:28.611804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 65/123] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:28 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:29.034750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:29.035402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:29.041694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.042645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.043519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.043955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.046243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:29.047067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:29.053967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.054474 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.055494 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.056003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.282329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.289458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.290135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6c24b84d-5c55-4410-a2d8-f8cb6be32238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.259102 May 27 16:29:29.290831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:29 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:29.298606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.300534 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.301268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25de1452-da31-476c-936e-e47a343c44fe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.259673 May 27 16:29:29.301861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 66/125] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:29 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:29.463507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:29.464865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:29.471890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.472545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.473498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.475220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:29.476634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:29.480973 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.485247 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.490507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.490507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.490507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.691685 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.699539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.701238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2522a213-03a5-4e3c-aacc-64aa56d7c21e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.241428 May 27 16:29:29.702341 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:29 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:29.706519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:29.708197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:29.708850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:29.709122 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1d998584-ad03-466d-b7bd-c67bf7ee8ff2 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.240758 May 27 16:29:29.716209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.716669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.717477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.717936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.729295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 67/127] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:29 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:29.768933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-e7715920-1228-47df-9748-0325b318c5a0 req-e0b57f82-3ab4-4ee4-bb91-c38a81211372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "name": "network-vif-plugged", "status": "completed", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:29.781870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-e7715920-1228-47df-9748-0325b318c5a0 req-e0b57f82-3ab4-4ee4-bb91-c38a81211372 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:29.782396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-e7715920-1228-47df-9748-0325b318c5a0 req-e0b57f82-3ab4-4ee4-bb91-c38a81211372 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:29.795379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-e7715920-1228-47df-9748-0325b318c5a0 req-e0b57f82-3ab4-4ee4-bb91-c38a81211372 service nova] Creating event network-vif-plugged:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:29:29.801096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-e7715920-1228-47df-9748-0325b318c5a0 req-e0b57f82-3ab4-4ee4-bb91-c38a81211372 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036888 May 27 16:29:29.801806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 68/128] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:29:29.860444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:29.868589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-deb7ca17-a547-45a5-90bb-5df2e7b551a2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.165178 May 27 16:29:29.873041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 61/129] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:29 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:30.309427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:30.310136 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:30.316615 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.317072 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.317924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.318362 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.319872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:30.321066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:30.328042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.328488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.329254 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.329733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.529829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.534421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.538485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65ca0bee-1e89-472d-8b69-ef128edcdb28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.234477 May 27 16:29:30.539137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 69/130] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:30 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:30.544951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.547109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.548295 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-916b96ad-6481-43b6-928f-916cb4aba3c1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.232452 May 27 16:29:30.548994 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 62/131] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:30 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:30.718887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:30.719509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:30.722778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:30.726474 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.726909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:30.727023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.727522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:30.727680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.728118 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.735428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.735872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.736628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.737229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.936084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.942566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:30.945187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-89c23ca0-36a1-4ad4-9246-cf3fba9ab600 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.230783 May 27 16:29:30.946408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 70/132] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:30 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:30.960029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:30.960850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:30.965679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-253ad772-8811-4203-8259-d95813e314b1 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1315 microversion: 2.1 time: 0.242425 May 27 16:29:30.971285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 63/133] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:30 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:30.972457 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.972908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:30.973708 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:30.974406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.115002 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:31.123164 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0f2a3016-f25a-4d50-a796-06ad887c0a96 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.174944 May 27 16:29:31.123748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 71/134] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:30 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:31.556840 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:31.557782 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:31.566487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:31.567143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:31.593537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.593940 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.595058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.595539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.596314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.596740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.597327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.598470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.926197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:31.927468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:31.935502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-225695e4-f86f-45e8-aeeb-804b77f77838 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.383600 May 27 16:29:31.940655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 64/135] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:31 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:31.941513 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:31.943358 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:31.946590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-29583065-fb46-4947-9146-5d5e3678fed2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.383940 May 27 16:29:31.947621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 72/136] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:31 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:31.962874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:31.963491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:31.971530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.971978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.972745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:31.973172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:31.990186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:31.993804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:32.003116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.003772 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.004800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.005333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.217546 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:32.229034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-97eb7770-580c-4d60-adb8-291e462d0300 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1501 microversion: 2.1 time: 0.242509 May 27 16:29:32.232783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:31 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:32.246090 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:32.248512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:32.256232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.256793 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.257608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.258047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.561436 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:32.570865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a564edfc-2bc4-4ce0-9483-b14d901eb44d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.611727 May 27 16:29:32.578164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 65/138] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:31 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:32.656901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:32.671739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e13d9d25-7a49-418a-929f-060781e4afa1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.437129 May 27 16:29:32.674549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 74/139] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:32 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:32.957744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:32.958438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:32.967617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.968067 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.968169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:32.968774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:32.968863 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.969263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.977269 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.977769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:32.979084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:32.979528 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:33.178181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.188144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.200654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.203771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.203771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eba68c46-cc7b-4898-9fea-5cccf1b4588a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.240356 May 27 16:29:33.205115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 75/140] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:32 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:29:33.218992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5aa53628-17ab-4475-a988-e9c7d2ce0d05 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.266521 May 27 16:29:33.219511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 66/141] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:32 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:33.596741 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:33.597682 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:33.604180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:33.604634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:33.605477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:33.606305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:33.688328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:33.688970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:33.695318 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:33.695833 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:33.696634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:33.697071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:33.880049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.891218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65fe4945-dbe3-4a32-922c-dfbb7cf0a695 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.298953 May 27 16:29:33.892428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 76/142] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:33 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:33.957094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:33.968113 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-47e51e2d-2f66-4cc0-ab1f-873b1a667ee1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.283445 May 27 16:29:34.009686 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 67/143] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:33 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:34.226204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:34.227254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:34.237141 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:34.238334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:34.240343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.241036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.242070 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.242833 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.247330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.248159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.249055 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.249703 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.654509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:34.662999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-39f9d93b-2e1b-435e-b232-900642dfb4e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.430097 May 27 16:29:34.664092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 68/144] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:34 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:34.671210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8545760-394e-4a8d-bd53-a1f5542e1cf3"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:34.674639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:34.684373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.685043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.686163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.686599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.687815 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:34.696751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:34.698262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:34.699757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ec3ea13a-7328-4b8d-8c0f-3d3cdb42f4e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1405 microversion: 2.20 time: 0.481204 May 27 16:29:34.700486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 77/145] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:34 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:34.706877 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-6175c362-ae7e-4afb-b2d6-921fcfdcf617 req-522c5c40-8ecc-4557-8701-2fbcdff888eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc97e34-9888-4c3d-9ea1-226e97c009c9", "name": "network-vif-plugged", "status": "completed", "tag": "8f129cf8-d17c-49bd-bb15-e74ecf6db21d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:34.718414 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6175c362-ae7e-4afb-b2d6-921fcfdcf617 req-522c5c40-8ecc-4557-8701-2fbcdff888eb service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.719158 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6175c362-ae7e-4afb-b2d6-921fcfdcf617 req-522c5c40-8ecc-4557-8701-2fbcdff888eb service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.734690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-6175c362-ae7e-4afb-b2d6-921fcfdcf617 req-522c5c40-8ecc-4557-8701-2fbcdff888eb service nova] Creating event network-vif-plugged:8f129cf8-d17c-49bd-bb15-e74ecf6db21d for instance edc97e34-9888-4c3d-9ea1-226e97c009c9 on hv-cinder-84049 May 27 16:29:34.740142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-6175c362-ae7e-4afb-b2d6-921fcfdcf617 req-522c5c40-8ecc-4557-8701-2fbcdff888eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038127 May 27 16:29:34.741263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 78/146] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:34.909195 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:34.910131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:34.918372 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.918829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:34.919666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:34.920128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.076889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:35.084423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-401bd37c-c1fa-48d2-890c-5c7fb7eeaaa3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.179656 May 27 16:29:35.085103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 79/147] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:34 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:35.089700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:35.090360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:35.096399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.096853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.097694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.098139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.279485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:35.287590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-63f11397-b9f1-4a60-a112-4246b8210a99 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.201412 May 27 16:29:35.288266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 80/148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:35 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:35.681523 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:35.682139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:35.689090 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.689566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.690330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.690762 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.842167 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:35.855864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-80827140-cd1c-4e7e-875f-5f906584b059 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.177646 May 27 16:29:35.866053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 81/149] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:35 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:35.869373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:35.870065 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:35.878757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.879241 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:35.884193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:35.884193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.074045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:36.083696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:36.085220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:36.086837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c6878b26-371a-4988-b1b1-14f722ee5bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1597 microversion: 2.20 time: 0.222201 May 27 16:29:36.087354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 82/150] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:29:35 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1597 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:29:36.106228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:36.107700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:36.116445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.116899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.117728 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.118171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.269148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:36.279105 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d08af2bf-f1c7-4e87-bb09-46b44f7698dd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.178601 May 27 16:29:36.279941 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 83/151] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:36 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:36.285570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:36.290924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:36.296126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.296887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.297966 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.298560 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.643963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-097f2ee4-a645-47bd-8cb4-0f4f215e3baa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.362279 May 27 16:29:36.649504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 84/152] 10.222.0.42 () {60 vars in 1315 bytes} [Fri May 27 16:29:36 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:29:36.655706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:36.656983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:36.665582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.666038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:36.667248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:36.668438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.102882 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:37.113329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c829ad47-2093-4380-9daf-40308669e8c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.467123 May 27 16:29:37.114825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 85/153] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:36 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:37.120096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-f8d18e92-ae21-4a73-bbe4-199d719fb2c3 req-8ae3a7b0-aa8b-4efc-9a26-28e5e9ca07bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a376bd1-2163-4333-a7a2-978057e231c5", "name": "network-vif-plugged", "status": "completed", "tag": "5e118c26-5265-4811-94b8-60efa598d923"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:37.128900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-f8d18e92-ae21-4a73-bbe4-199d719fb2c3 req-8ae3a7b0-aa8b-4efc-9a26-28e5e9ca07bf service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:37.129688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-f8d18e92-ae21-4a73-bbe4-199d719fb2c3 req-8ae3a7b0-aa8b-4efc-9a26-28e5e9ca07bf service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.134120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:37.142128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-f8d18e92-ae21-4a73-bbe4-199d719fb2c3 req-8ae3a7b0-aa8b-4efc-9a26-28e5e9ca07bf service nova] Creating event network-vif-plugged:5e118c26-5265-4811-94b8-60efa598d923 for instance 8a376bd1-2163-4333-a7a2-978057e231c5 on hv-cinder-84049 May 27 16:29:37.165037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-f8d18e92-ae21-4a73-bbe4-199d719fb2c3 req-8ae3a7b0-aa8b-4efc-9a26-28e5e9ca07bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 May 27 16:29:37.165037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 86/154] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:37.187685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:37.188408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:37.205274 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:37.207992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.209011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:37.209822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.479139 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-089a7436-f5e8-4543-b505-97f404109c31 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "POST /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.813082 May 27 16:29:37.481256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 69/155] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:29:34 2022] POST /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d/os-volume_attachments => generated 194 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:37.507374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:37.509916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:37.531282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:37.531912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.538446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:37.538446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:37.716623 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:37.725545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7fa739d2-14c7-4fc4-b913-0e423c908856 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.549324 May 27 16:29:37.726936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 87/156] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:37 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:37.897897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:37.908530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3bad0d5d-49a2-4dd5-b03f-22d4e36d2fc1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.424709 May 27 16:29:37.909689 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 70/157] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:37 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:38.139387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:38.139387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:38.144877 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.145709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:38.146637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.147758 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:38.616197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:38.635956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2bf1b2e6-8046-4003-9ddc-1e031d9e5eb9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.504637 May 27 16:29:38.642775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 88/158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:38 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:38.744145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:38.744657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:38.760138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.763704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:38.763704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.763704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:38.926291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:38.927131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:38.969999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.970466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:38.990440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:38.991085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:39.080969 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:39.091683 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e53ee694-7256-439d-ac17-56b306c6a900 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.351303 May 27 16:29:39.096038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 71/159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:38 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:39.108434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-fa49eccc-a4f6-4434-bddd-7e45ddc25db1 req-9956c290-20fd-49e4-8517-ee8910e2830f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:39.128882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fa49eccc-a4f6-4434-bddd-7e45ddc25db1 req-9956c290-20fd-49e4-8517-ee8910e2830f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:39.130109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fa49eccc-a4f6-4434-bddd-7e45ddc25db1 req-9956c290-20fd-49e4-8517-ee8910e2830f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:39.151929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-fa49eccc-a4f6-4434-bddd-7e45ddc25db1 req-9956c290-20fd-49e4-8517-ee8910e2830f service nova] Creating event network-changed:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:29:39.157151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-fa49eccc-a4f6-4434-bddd-7e45ddc25db1 req-9956c290-20fd-49e4-8517-ee8910e2830f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058526 May 27 16:29:39.158234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 72/160] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:39.185070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-acd96513-288a-4537-b437-3ec9c156984b req-da5bf525-9ed0-44e9-9a5d-d55e9ea72f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5220d569-8535-429a-bfff-fa0955dec2c0", "name": "network-vif-plugged", "status": "completed", "tag": "61d181d0-5525-4601-81ec-69cc30f5255c"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:39.195266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-acd96513-288a-4537-b437-3ec9c156984b req-da5bf525-9ed0-44e9-9a5d-d55e9ea72f98 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:39.195705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-acd96513-288a-4537-b437-3ec9c156984b req-da5bf525-9ed0-44e9-9a5d-d55e9ea72f98 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:39.226709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:39.252918 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-507c9e1f-9fb3-43a3-906a-fd2842b587b7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.330310 May 27 16:29:39.253563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 89/161] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:38 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:39.397476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-acd96513-288a-4537-b437-3ec9c156984b req-da5bf525-9ed0-44e9-9a5d-d55e9ea72f98 service nova] Creating event network-vif-plugged:61d181d0-5525-4601-81ec-69cc30f5255c for instance 5220d569-8535-429a-bfff-fa0955dec2c0 on hv-cinder-84049 May 27 16:29:39.403143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-acd96513-288a-4537-b437-3ec9c156984b req-da5bf525-9ed0-44e9-9a5d-d55e9ea72f98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221629 May 27 16:29:39.404393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 73/162] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:29:39.660716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:39.666599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:39.671454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:39.672251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:39.675174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:39.675829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:39.896600 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:39.905823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-37f3a814-72bb-41ca-9f4d-069a98aaba80 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.249199 May 27 16:29:39.919759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 90/163] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:39 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:40.116979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:40.118285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:40.129281 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.130136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:40.131508 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.132171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:40.270352 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:40.271003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:40.278213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.278670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:40.285920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.286445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:40.391078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:40.395277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:40.411185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6d5e9cf4-6dbc-445a-bc15-8daa9af34e28 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.302180 May 27 16:29:40.413802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 74/164] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:40 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:40.467509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:40.475892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6a629176-6743-4f23-a74a-9ed598bace19 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1321 microversion: 2.1 time: 0.209497 May 27 16:29:40.477170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 91/165] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:40 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:40.928052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:40.928807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:40.942861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.943318 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:40.944101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:40.944536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.095936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:41.103383 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7a3a47fb-29b8-41fe-a6f3-4bfbdd88c3d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.180106 May 27 16:29:41.103946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 75/166] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:40 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:41.420851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-450846fd-8c53-4724-882b-31871056bb4a req-e12911cf-8518-4050-8736-2391a21fad0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3034be98-8230-4ba1-bfd9-cb4e4cf776af", "name": "network-vif-plugged", "status": "completed", "tag": "41c308ca-1a37-4303-834e-73089831b6de"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:41.430502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:41.430927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-450846fd-8c53-4724-882b-31871056bb4a req-e12911cf-8518-4050-8736-2391a21fad0a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.431006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-450846fd-8c53-4724-882b-31871056bb4a req-e12911cf-8518-4050-8736-2391a21fad0a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.432929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:41.439006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.439652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.440737 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.441420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.444376 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-450846fd-8c53-4724-882b-31871056bb4a req-e12911cf-8518-4050-8736-2391a21fad0a service nova] Creating event network-vif-plugged:41c308ca-1a37-4303-834e-73089831b6de for instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af on hv-cinder-84049 May 27 16:29:41.449519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-450846fd-8c53-4724-882b-31871056bb4a req-e12911cf-8518-4050-8736-2391a21fad0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 May 27 16:29:41.451211 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 92/167] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:41.495636 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:41.498632 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:41.519838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.520586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.521559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.522198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.634946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:41.643173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-09fafbac-ad38-43fb-845f-73f02acf3e8f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.216888 May 27 16:29:41.643761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 76/168] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:41 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:41.694164 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:41.707881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d30a1845-4421-42d4-b920-23c00fa02469 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1514 microversion: 2.1 time: 0.213784 May 27 16:29:41.707881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 93/169] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:41 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:41.726283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:41.727286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:41.735614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.736064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.737031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:41.737506 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:41.763444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'flavor' on Instance uuid 8a376bd1-2163-4333-a7a2-978057e231c5 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:29:42.124560 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:42.124560 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:42.124728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b855f8ec-327f-42bd-a40b-5288f300b3a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5/action" status: 200 len: 32 microversion: 2.1 time: 0.402376 May 27 16:29:42.124728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 77/170] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:29:41 2022] POST /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:29:42.128586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.129047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.129867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.130310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.134186 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:42.134895 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:42.142296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.142778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.143685 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.144242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.344729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:42.358728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:42.365242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9e9cbc49-10c8-445d-ba85-fe0d9b7096da tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.248296 May 27 16:29:42.365871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 94/171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:42 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:42.381519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-06167574-465a-4efc-8b96-5d30e1069819 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.252134 May 27 16:29:42.381803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 78/172] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:42 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:42.664431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:42.664431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:42.671477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.671477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.671477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:42.671477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:42.810757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:42.818507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-37f8ba71-7cd3-4627-b4e8-725c8e7dc10c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.162560 May 27 16:29:42.819107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 95/173] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:42 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:43.383328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:43.384094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:43.391750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.392204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.393075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.393884 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.399913 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:43.401522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:43.410067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.410468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.411943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.412645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.634865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:43.639470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:43.643858 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6aaf0bb6-88e7-4e46-a623-a53f627360ec tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.264775 May 27 16:29:43.644529 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 79/174] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:43 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:43.647339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ad8a1320-f0da-47e5-bf0a-e9b9e0a5f3d6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.253047 May 27 16:29:43.647898 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 96/175] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:43 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:43.836310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:43.836310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:43.842181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.842628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.843399 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:43.843828 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:43.983468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:43.991149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f6803c3e-36a0-4c1a-bc25-86b7143382b3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.160212 May 27 16:29:43.991722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 80/176] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:43 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:44.660883 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:44.661698 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:44.668075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:44.668648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:44.668751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:44.669035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:44.673418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:44.673418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:44.673608 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:44.677187 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:44.677665 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:44.678434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:44.678862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.214371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:45.214527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:45.214640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7a856209-02e0-4078-bf27-b043429929c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.257555 May 27 16:29:45.214640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 97/177] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:44 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:45.214799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0471200c-d507-4b92-adfb-80ff6992a544 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.254455 May 27 16:29:45.214799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 81/178] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:44 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:45.214965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:45.214965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:45.214965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.214965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.215276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.215276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.215276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:45.215520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1ae5b750-be52-4639-bdd3-33f3356b4deb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.153197 May 27 16:29:45.215520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 98/179] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:45 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:45.938063 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:45.938683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:45.942696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:45.943367 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:45.944973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.945445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.954667 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.955213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.971825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.973477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:45.974283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:45.977565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:46.256397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:46.265402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-48a338ec-6877-43e1-bc03-eba82463729c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1362 microversion: 2.1 time: 0.331799 May 27 16:29:46.265934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 99/180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:45 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:46.280709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:46.281917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:46.282763 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:46.289026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:46.289716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:46.290390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fe759662-cefe-4df7-96fe-9e51b2bb38f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.356860 May 27 16:29:46.290986 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 82/181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:45 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:46.291650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:46.292325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:46.460401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:46.472064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4105d153-3e8c-4b62-9b95-7ee5dd071f35 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.203207 May 27 16:29:46.474945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 100/182] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:46 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:47.286866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:47.288198 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:47.295646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.296097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.296868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.297307 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.307748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:47.308355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:47.321059 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.322083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.323169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.323822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.597129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:47.602007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:47.609413 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0e794441-3395-4c7b-a9ac-4103b2a656d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.305281 May 27 16:29:47.610509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 101/183] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:47 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:47.617140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:47.617955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:47.618147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3cf9747a-39d2-44a0-b2da-9ffb5207f915 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1548 microversion: 2.1 time: 0.334859 May 27 16:29:47.626096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 83/184] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:47 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1548 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:47.626330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.626781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.627710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.628291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.637514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:47.638097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:47.644735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.645188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.646001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:47.646438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:47.776813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3ad66a34-8c5c-4eab-b67b-922a9b743419 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131773 May 27 16:29:47.776813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 84/185] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:29:47 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:29:47.811351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:47.819277 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-cffd06cc-1fab-42e2-bb3e-d281d595da89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.207546 May 27 16:29:47.819852 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 102/186] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:47 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:48.628231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:48.628851 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:48.636482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:48.636936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:48.637827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:48.638757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:48.819361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:48.828799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bddd68bb-a084-447a-b9c5-6c19f9197abc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.205302 May 27 16:29:48.829431 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 85/187] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:48 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:48.844027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:48.844960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:48.852171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:48.852975 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:48.853911 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:48.854425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:49.066557 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:49.075948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-50db091d-33ff-4db3-9bab-221faa47d615 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.243248 May 27 16:29:49.076789 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 103/188] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:48 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:49.285190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-c8bb0424-975e-4c4c-8624-de3787f17587 req-1576f6f6-9847-4d47-9f25-75492a00e176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5220d569-8535-429a-bfff-fa0955dec2c0", "tag": "61d181d0-5525-4601-81ec-69cc30f5255c"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:49.295889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c8bb0424-975e-4c4c-8624-de3787f17587 req-1576f6f6-9847-4d47-9f25-75492a00e176 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:49.296344 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c8bb0424-975e-4c4c-8624-de3787f17587 req-1576f6f6-9847-4d47-9f25-75492a00e176 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:49.309032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-c8bb0424-975e-4c4c-8624-de3787f17587 req-1576f6f6-9847-4d47-9f25-75492a00e176 service nova] Creating event network-changed:61d181d0-5525-4601-81ec-69cc30f5255c for instance 5220d569-8535-429a-bfff-fa0955dec2c0 on hv-cinder-84049 May 27 16:29:49.315439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-c8bb0424-975e-4c4c-8624-de3787f17587 req-1576f6f6-9847-4d47-9f25-75492a00e176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034636 May 27 16:29:49.316044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 86/189] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:49.847313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:49.848119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:49.860157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:49.860726 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:49.869012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:49.869012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:49.869012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:50.049214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:50.058315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e83f999b-321d-4962-a103-44bc5db6b9a3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.215392 May 27 16:29:50.061052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 104/190] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:49 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:50.097601 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:50.099444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:50.108958 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:50.109447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:50.110379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:50.110824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:50.267613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:50.280111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5d0012fa-26f6-416d-bf0b-e940dfe77c60 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.187612 May 27 16:29:50.280751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 87/191] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:50 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:51.076303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:51.081316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:51.083178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:51.083654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:51.084418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:51.084852 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:51.218873 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:51.226309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-df5f9b08-9ada-4590-8bea-1f68eb619aa6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.154400 May 27 16:29:51.226871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 105/192] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:51 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:51.296264 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:51.297622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:51.312713 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:51.313212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:51.314040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:51.314491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:51.449585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:51.460108 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2cab5c1a-bc21-4265-a37a-122e4e0bda21 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.167915 May 27 16:29:51.460731 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 88/193] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:51 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:52.242854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:52.243387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:52.249527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:52.249984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:52.250751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:52.251191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:52.396319 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:52.403565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-efe484ea-05ff-4814-b508-b63b15cfcb03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.164645 May 27 16:29:52.404724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 106/194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:52 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:52.478094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:52.478677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:52.491295 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:52.491744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:52.492525 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:52.493174 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:52.704277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:52.732868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8a200b03-a516-41cd-a5d0-050a657cd17b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1368 microversion: 2.1 time: 0.258642 May 27 16:29:52.733493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 89/195] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:52 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:53.437057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:53.437817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:53.468518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.469279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:53.470641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.471413 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:53.649709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:53.658215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-200b9631-ef77-4ec2-9f83-0c3abc9348f8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.230724 May 27 16:29:53.658791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 107/196] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:53 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:53.751944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:53.752568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:53.758977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.759425 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:53.760216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.760647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:53.775929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:53.896672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:53.904153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9eec7e07-2a99-42b2-861a-3cc7bb5ff8fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1557 microversion: 2.1 time: 0.156605 May 27 16:29:53.905283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 90/197] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:53 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:53.921841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:53.922316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:53.930507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.931212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:53.932144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:53.932720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:54.042067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-12edb1d3-7ff2-43dd-a62d-ba101b17b238 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124201 May 27 16:29:54.042707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 108/198] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:29:53 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:54.676110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:54.676722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:54.683323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:54.683770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:54.684537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:54.684976 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:55.122197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:55.130653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-14fb2b0f-ae86-4b69-a5b5-6d6dd6f0b230 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.458664 May 27 16:29:55.131349 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 91/199] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:54 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:55.405553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-041eb33b-331b-4ee5-b6e4-8f9e0536d82c req-c7831bef-f6bd-4eb8-85c5-5079edc2aa23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3034be98-8230-4ba1-bfd9-cb4e4cf776af", "tag": "41c308ca-1a37-4303-834e-73089831b6de"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:29:55.414841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-041eb33b-331b-4ee5-b6e4-8f9e0536d82c req-c7831bef-f6bd-4eb8-85c5-5079edc2aa23 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:55.415288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-041eb33b-331b-4ee5-b6e4-8f9e0536d82c req-c7831bef-f6bd-4eb8-85c5-5079edc2aa23 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:55.427651 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-041eb33b-331b-4ee5-b6e4-8f9e0536d82c req-c7831bef-f6bd-4eb8-85c5-5079edc2aa23 service nova] Creating event network-changed:41c308ca-1a37-4303-834e-73089831b6de for instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af on hv-cinder-84049 May 27 16:29:55.432954 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-041eb33b-331b-4ee5-b6e4-8f9e0536d82c req-c7831bef-f6bd-4eb8-85c5-5079edc2aa23 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 May 27 16:29:55.433592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 109/200] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:29:56.148718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:56.156635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:56.165376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:56.165861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:56.166643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:56.167075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:56.311825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:56.319834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8dad4396-d9fa-4567-8b9a-a507c74893ab tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.175621 May 27 16:29:56.320429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 92/201] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:56 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:57.340914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:57.343608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:57.358056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:57.358655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:57.359732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:57.360170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:57.618661 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:57.666813 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7c4ffe79-66bd-4ca7-994a-dc49cb4c6c80 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.330221 May 27 16:29:57.668116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 110/202] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:57 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:58.300174 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:58.300927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:58.308474 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.309100 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.310052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.311172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.345171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:29:58.682646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4be58930-cd54-451c-9640-c27a2b842e10 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 204 len: 0 microversion: 2.1 time: 0.386157 May 27 16:29:58.683336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 93/203] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:29:58 2022] DELETE /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:29:58.688946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:58.690973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:58.699725 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.700038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:58.700610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:29:58.700991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.702475 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.703504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.708497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.708954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.709809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:29:58.710321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:29:58.967541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:58.977865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7635d7e1-63f4-4916-b7ca-6f9fb4bed290 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1553 microversion: 2.1 time: 0.283308 May 27 16:29:58.987116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 94/204] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:58 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:29:59.004596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:29:59.013102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1b4dbd28-c933-4457-9e16-01b15b2f82d8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.330477 May 27 16:29:59.014558 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 111/205] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:58 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:29:59.997078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:29:59.997879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:00.005037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:00.005527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:00.006352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:00.006790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:00.030597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:00.031366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:00.037791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:00.038372 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:00.039339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:00.040022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:00.209885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:00.218433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3751071c-f937-4e58-91fb-be63e87ee8af tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1553 microversion: 2.1 time: 0.225136 May 27 16:30:00.219372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 95/206] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:29:59 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:00.249870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:00.259213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e70cff27-223a-47a2-9a5c-e4109a46b7e7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.232574 May 27 16:30:00.260720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 112/207] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:00 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:01.236796 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:01.238010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:01.249664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:01.250387 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:01.253150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:01.253150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:01.283431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:01.285007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:01.292230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=85 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:01.294270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:01.295389 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:01.296747 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:01.298052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:01.445962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:01.452875 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-69478181-b00a-4b15-9903-5b4c4b3e50d5 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1553 microversion: 2.1 time: 0.220640 May 27 16:30:01.453837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 96/208] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:01 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:01.473789 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:01.485428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e4c0831e-edd9-4536-9d4a-94cf1f6684c8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.212077 May 27 16:30:01.486221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 113/209] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:01 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:02.242256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-3082d69e-09e1-417d-8e1d-c93041bce5e3 req-f7924cc1-7e35-4311-b761-16fbdd6c5008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6667842-dd11-4097-a37f-2098f2a79c9d", "name": "network-vif-deleted", "tag": "828e7b2d-5a1e-4b47-a5bb-001643444ef5"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:02.253014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3082d69e-09e1-417d-8e1d-c93041bce5e3 req-f7924cc1-7e35-4311-b761-16fbdd6c5008 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:02.253587 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3082d69e-09e1-417d-8e1d-c93041bce5e3 req-f7924cc1-7e35-4311-b761-16fbdd6c5008 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:02.266223 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-3082d69e-09e1-417d-8e1d-c93041bce5e3 req-f7924cc1-7e35-4311-b761-16fbdd6c5008 service nova] Creating event network-vif-deleted:828e7b2d-5a1e-4b47-a5bb-001643444ef5 for instance a6667842-dd11-4097-a37f-2098f2a79c9d on hv-cinder-84049 May 27 16:30:02.280637 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-3082d69e-09e1-417d-8e1d-c93041bce5e3 req-f7924cc1-7e35-4311-b761-16fbdd6c5008 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049096 May 27 16:30:02.281217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 97/210] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:30:02.470622 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:02.471417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:02.477497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:02.477956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:02.478721 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:02.479155 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:02.503938 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:02.504821 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:02.511434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:02.511795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:02.512678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:02.513106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:02.550811 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:02.559507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0030069d-72cb-4668-9e11-e02cd09dff12 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1346 microversion: 2.1 time: 0.092922 May 27 16:30:02.560085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 114/211] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:02 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:02.649421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:02.657861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e1dd4dbc-9aa8-4e02-9383-b5e601a866b8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.158922 May 27 16:30:02.658443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 98/212] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:02 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:03.578654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:03.579296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:03.586041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:03.586491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:03.587305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:03.587750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:03.650724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:03.659094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f87a7e0f-741e-4401-845a-8dc91e6267ff tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1346 microversion: 2.1 time: 0.085368 May 27 16:30:03.659679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 115/213] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:03 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:03.675575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:03.676257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:03.682889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:03.683762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:03.684193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:03.684623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:03.822811 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:03.830750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b1428d7e-8b6d-4c58-bcb9-6ecd105e9436 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.159088 May 27 16:30:03.831329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 99/214] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:03 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:04.676215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:04.676824 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:04.682955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:04.683405 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:04.684167 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:04.684606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:04.746061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:04.754480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6ba17c46-87e7-4106-b761-dade2d79b312 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1346 microversion: 2.1 time: 0.082336 May 27 16:30:04.755046 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 116/215] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:04 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:04.847642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:04.848873 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:04.855260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:04.855706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:04.856470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:04.856902 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:04.990399 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:04.998115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c356bac1-fadf-4d03-82ae-587c34c9672f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.154387 May 27 16:30:04.999331 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 100/216] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:04 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:05.771770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:05.772351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:05.778407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:05.778847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:05.779603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:05.780144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:05.840908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:05.849187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5ea9d36c-163b-49f5-b5bd-8d9561c469c0 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1346 microversion: 2.1 time: 0.081198 May 27 16:30:05.849824 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 117/217] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:05 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:06.016938 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:06.017604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:06.024213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:06.024653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:06.025541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:06.025977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:06.164362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:06.172446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-082de144-569e-4196-b76b-fd6a51405380 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.160161 May 27 16:30:06.173023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 101/218] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:06 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:06.866496 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:06.867398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:06.873608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:06.874665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:06.876469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:06.876469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:06.906344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:06.906872 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:06.907355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lazy-loading 'fault' on Instance uuid a6667842-dd11-4097-a37f-2098f2a79c9d {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:30:06.952669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a422ada9ab43609a7940a1df349b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32666b3567c94e06a7f720c1abe2a8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:06.960488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8bc2cb61-734c-40fd-8bdd-7c58f109f0fb tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 200 len: 1351 microversion: 2.1 time: 0.097898 May 27 16:30:06.961090 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 118/219] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:06 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:07.188970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:07.189613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:07.196071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:07.196506 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:07.197255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:07.197871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:07.334827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:07.350681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-892e60bd-50c2-435c-8001-5dcdafdece55 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.165506 May 27 16:30:07.351252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 102/220] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:07 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:07.978583 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:07.979506 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:07.987729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:07.988182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:07.988951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:07.989409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:08.003102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] HTTP exception thrown: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Request method failure captured: May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d HTTP/1.1 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw6zvUI1UlY8Zu03VYBVXZeo0eJVqRScWFoZl7SifUNduz5Er6yLJMAW1-L2h7EZbCbV6GrZACgktbi9RqGSKucya4wR4KVk6wnmpG5TRmGaZuogVBzVxiBbE0K7oqDYOS2K0iPS-H245OQdhSTRyamG1VhUn45fPyg3jLD5NozfMw May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:08.007707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32666b3567c94e06a7f720c1abe2a8b7", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: a0a422ada9ab43609a7940a1df349b7b May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.009227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'a6667842-dd11-4097-a37f-2098f2a79c9d'} May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:08.010106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.011231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:08.012221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Returning 404 to user: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:08.012221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-475c700f-e313-4594-9b8f-da70162bebc4 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 404 len: 111 microversion: 2.1 time: 0.035014 May 27 16:30:08.012221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 119/221] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:07 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:30:08.222868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:08.232864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:08.232864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:08.232864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:08.232864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:08.234457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:08.246778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] HTTP exception thrown: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Request method failure captured: May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d/os-volume_attachments HTTP/1.1 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPw6zvUI1UlY8Zu03VYBVXZeo0eJVqRScWFoZl7SifUNduz5Er6yLJMAW1-L2h7EZbCbV6GrZACgktbi9RqGSKucya4wR4KVk6wnmpG5TRmGaZuogVBzVxiBbE0K7oqDYOS2K0iPS-H245OQdhSTRyamG1VhUn45fPyg3jLD5NozfMw May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:30:08.253594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32666b3567c94e06a7f720c1abe2a8b7", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: a0a422ada9ab43609a7940a1df349b7b May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.255087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'server_id': 'a6667842-dd11-4097-a37f-2098f2a79c9d'} May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:08.255876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:08.263501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:08.265190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Returning 404 to user: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:08.265190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6bd2620c-4941-4695-8add-70be9663466b tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037885 May 27 16:30:08.265190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 103/222] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:30:08 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:30:08.376476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:08.390218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:08.393144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:08.394260 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:08.395154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:08.397075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:08.538237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:08.545867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-22d5b5d3-1297-4afd-83e5-bda71a6f6a97 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.178964 May 27 16:30:08.546581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 120/223] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:08 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:09.566131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:09.566735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:09.574464 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.574907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.575682 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.576113 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.712872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:09.721773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-211ee073-fd0d-45cc-80a2-12513e3a147c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.159389 May 27 16:30:09.722345 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 104/224] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:09 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:09.790412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:09.790905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:09.797486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.797929 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.798678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.799106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.812195 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] HTTP exception thrown: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Request method failure captured: May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d HTTP/1.1 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPw6zvUI1UlY8Zu03VYBVXZeo0eJVqRScWFoZl7SifUNduz5Er6yLJMAW1-L2h7EZbCbV6GrZACgktbi9RqGSKucya4wR4KVk6wnmpG5TRmGaZuogVBzVxiBbE0K7oqDYOS2K0iPS-H245OQdhSTRyamG1VhUn45fPyg3jLD5NozfMw May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:09.813696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32666b3567c94e06a7f720c1abe2a8b7", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: a0a422ada9ab43609a7940a1df349b7b May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.815086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'a6667842-dd11-4097-a37f-2098f2a79c9d'} May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:09.815968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.817252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:09.818737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Returning 404 to user: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:09.818737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-09354771-abf5-4a8e-bbdb-d13f90cb3a59 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 404 len: 111 microversion: 2.1 time: 0.028436 May 27 16:30:09.818737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 121/225] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:30:09 2022] DELETE /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:30:09.823633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:09.824242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] [instance: a6667842-dd11-4097-a37f-2098f2a79c9d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:09.831146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.831593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.832911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:09.833732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:09.851709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] HTTP exception thrown: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Request method failure captured: May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d HTTP/1.1 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPw6zvUI1UlY8Zu03VYBVXZeo0eJVqRScWFoZl7SifUNduz5Er6yLJMAW1-L2h7EZbCbV6GrZACgktbi9RqGSKucya4wR4KVk6wnmpG5TRmGaZuogVBzVxiBbE0K7oqDYOS2K0iPS-H245OQdhSTRyamG1VhUn45fPyg3jLD5NozfMw May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:30:09.853996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32666b3567c94e06a7f720c1abe2a8b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32666b3567c94e06a7f720c1abe2a8b7", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 32666b3567c94e06a7f720c1abe2a8b7 May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-DeleteServersTestJSON-698592772 May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: a0a422ada9ab43609a7940a1df349b7b May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-DeleteServersTestJSON-698592772-project May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.855115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'a6667842-dd11-4097-a37f-2098f2a79c9d'} May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:09.855745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. May 27 16:30:09.856820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:09.858030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] Returning 404 to user: Instance a6667842-dd11-4097-a37f-2098f2a79c9d could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:09.858030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9501c064-2041-4873-b493-d775c174d373 tempest-DeleteServersTestJSON-698592772 tempest-DeleteServersTestJSON-698592772-project] 10.222.0.42 "GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d" status: 404 len: 111 microversion: 2.1 time: 0.035871 May 27 16:30:09.858030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 105/226] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:09 2022] GET /compute/v2.1/servers/a6667842-dd11-4097-a37f-2098f2a79c9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:30:10.739499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:10.740102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:10.746293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:10.746739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:10.751045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:10.751045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:11.165013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:11.167563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:11.175227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-560c6200-362b-4954-b0ee-807e8bcc9c64 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.439678 May 27 16:30:11.175807 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 122/227] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:10 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:12.192505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:12.193926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:12.207911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:12.207911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:12.208346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:12.208993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:12.377053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:12.385547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-763871e4-434b-43ad-85f8-0307bcb8552f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.197032 May 27 16:30:12.386784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 106/228] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:12 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:13.245582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f9e15cf5-325e-4d86-9e4e-121b2730747b tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Action: 'create', calling method: .version_select at 0x7f0e9a026700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-509904651", "metadata": {"Type": "work"}}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f9e15cf5-325e-4d86-9e4e-121b2730747b tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 121 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:13.255469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-509904651", "metadata": {"Type": "work"}}} May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:30:13.256914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-509904651', 'metadata': {'Type': 'work'}}}} May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise error May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi '#$%' May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.257806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 16:30:13.259184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 16:30:13.269717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 16:30:13.269717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.269717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f9e15cf5-325e-4d86-9e4e-121b2730747b tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.269717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f9e15cf5-325e-4d86-9e4e-121b2730747b tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132256 May 27 16:30:13.269717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 123/229] 10.222.0.42 () {60 vars in 1155 bytes} [Fri May 27 16:30:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 16:30:13.270178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8bde8877-e1fa-4463-a1ea-77192acc1ed9 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Action: 'create', calling method: .version_select at 0x7f0e9995da60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1274316857", "metadata": {"Type": "work"}}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8bde8877-e1fa-4463-a1ea-77192acc1ed9 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 120 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:30:13.272817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1274316857", "metadata": {"Type": "work"}}} May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: May 27 16:30:13.274179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1274316857', 'metadata': {'Type': 'work'}}}} May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise error May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi '0' May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.274942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 16:30:13.276674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 16:30:13.278013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 16:30:13.278013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.278013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8bde8877-e1fa-4463-a1ea-77192acc1ed9 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.278013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8bde8877-e1fa-4463-a1ea-77192acc1ed9 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010721 May 27 16:30:13.282802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 107/230] 10.222.0.42 () {60 vars in 1155 bytes} [Fri May 27 16:30:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 16:30:13.287556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9ab0c7f9-c1e8-4388-abea-5d2e5337b34d tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Action: 'create', calling method: .version_select at 0x7f0e9a04d430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2003765244", "metadata": {"Type": "work"}}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9ab0c7f9-c1e8-4388-abea-5d2e5337b34d tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 119 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:13.290088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2003765244", "metadata": {"Type": "work"}}} May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:30:13.291487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2003765244', 'metadata': {'Type': 'work'}}}} May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise error May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi '' May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.300719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 16:30:13.302197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 16:30:13.303415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 16:30:13.303415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.303415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9ab0c7f9-c1e8-4388-abea-5d2e5337b34d tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.303415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9ab0c7f9-c1e8-4388-abea-5d2e5337b34d tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007772 May 27 16:30:13.303415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 124/231] 10.222.0.42 () {60 vars in 1155 bytes} [Fri May 27 16:30:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 16:30:13.308509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-04b0ff31-9724-420d-91d1-e43d1c81aaba tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Calling method '.version_select at 0x7f0e997c7550>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:13.344235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-04b0ff31-9724-420d-91d1-e43d1c81aaba tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] HTTP exception thrown: Volume tempest-invalid-473912305 could not be found. May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-04b0ff31-9724-420d-91d1-e43d1c81aaba tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-473912305 HTTP/1.1 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:30:13.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Volume tempest-invalid-473912305 could not be found. May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'tempest-invalid-473912305'} May 27 16:30:13.347308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-473912305 could not be found. (HTTP 404) (Request-ID: req-52c2513f-fb8a-426b-b34a-6a1067c7e3f3) May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.347990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:30:13.349009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-473912305 could not be found. May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:13.350201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-473912305 could not be found. May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-473912305 could not be found. May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-04b0ff31-9724-420d-91d1-e43d1c81aaba tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 404 to user: Volume tempest-invalid-473912305 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-04b0ff31-9724-420d-91d1-e43d1c81aaba tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-473912305" status: 404 len: 98 microversion: 2.1 time: 0.043395 May 27 16:30:13.351236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 108/232] 10.222.0.42 () {58 vars in 1214 bytes} [Fri May 27 16:30:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-473912305 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 16:30:13.359959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4c0135e3-f39c-4daf-87a0-938d6e1b949b tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006393 May 27 16:30:13.360755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 125/233] 10.222.0.42 () {58 vars in 1139 bytes} [Fri May 27 16:30:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 16:30:13.371835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-690a1863-86dc-429a-8008-d2416b4a9757 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003848 May 27 16:30:13.372263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 109/234] 10.222.0.42 () {58 vars in 1136 bytes} [Fri May 27 16:30:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 16:30:13.382262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-730d7c97-cb9b-4af9-bbef-1893fa3be002 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Calling method '.version_select at 0x7f0e9a082ee0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:13.405045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:13.405887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:13.413650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:13.414058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:13.414897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:13.415329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:13.417841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-730d7c97-cb9b-4af9-bbef-1893fa3be002 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] HTTP exception thrown: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-730d7c97-cb9b-4af9-bbef-1893fa3be002 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/os-volumes/d723db3a-cffe-4b48-a2f9-a58f9f88e6ea HTTP/1.1 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:13.420863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'd723db3a-cffe-4b48-a2f9-a58f9f88e6ea'} May 27 16:30:13.422174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. (HTTP 404) (Request-ID: req-b4a5b0e5-1fcb-42cc-bc09-8e6eb4a68f80) May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.423055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 16:30:13.424593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 16:30:13.425822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-730d7c97-cb9b-4af9-bbef-1893fa3be002 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 404 to user: Volume d723db3a-cffe-4b48-a2f9-a58f9f88e6ea could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-730d7c97-cb9b-4af9-bbef-1893fa3be002 tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d723db3a-cffe-4b48-a2f9-a58f9f88e6ea" status: 404 len: 109 microversion: 2.1 time: 0.044833 May 27 16:30:13.427004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 126/235] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:30:13 2022] DELETE /compute/v2.1/os-volumes/d723db3a-cffe-4b48-a2f9-a58f9f88e6ea => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:30:13.433351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7dd51bf-014c-4ce1-be71-8120ef0204ad tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Calling method '.version_select at 0x7f0e9a026e50>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:13.438109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:13.494659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-a7dd51bf-014c-4ce1-be71-8120ef0204ad tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] HTTP exception thrown: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7dd51bf-014c-4ce1-be71-8120ef0204ad tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Request method failure captured: May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/os-volumes/78d746d4-729c-4c2e-ad05-eaa13b20effe HTTP/1.1 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPyVUI-iYP5ehY2lCR0vF11QQEXCWh1f8noHYScD7flzgWAzPrDmTkQY_ykiR6g7QzIVbeNGDeNkDuwcuYo-043UMiKWeLisNCEP1IeEszRCZmPGfgo_naMdJH_xH8_O7tcqFc2sScUxBlOV16f6NlCbATHrpR_eys19XkbWm7oYdKk May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:30:13.496868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd7f849538d44293999c28b49a00bed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd7f849538d44293999c28b49a00bed8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: cd7f849538d44293999c28b49a00bed8 May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesNegativeTest-1172546836 May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 54cfca53919a42b2a420512b60d43b36 May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesNegativeTest-1172546836-project May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '78d746d4-729c-4c2e-ad05-eaa13b20effe'} May 27 16:30:13.498287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. (HTTP 404) (Request-ID: req-8f85be3e-d6be-46af-86da-de2329032c90) May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.499124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:30:13.502036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 16:30:13.503257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. May 27 16:30:13.505296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:30:13.509931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7dd51bf-014c-4ce1-be71-8120ef0204ad tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] Returning 404 to user: Volume 78d746d4-729c-4c2e-ad05-eaa13b20effe could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:13.509931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7dd51bf-014c-4ce1-be71-8120ef0204ad tempest-VolumesNegativeTest-1172546836 tempest-VolumesNegativeTest-1172546836-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/78d746d4-729c-4c2e-ad05-eaa13b20effe" status: 404 len: 109 microversion: 2.1 time: 0.079132 May 27 16:30:13.509931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 127/236] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:30:13 2022] GET /compute/v2.1/os-volumes/78d746d4-729c-4c2e-ad05-eaa13b20effe => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:30:13.583776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:13.591801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-22ac02bd-45d7-4b6d-9986-98a47274f9d0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.191813 May 27 16:30:13.592717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 110/237] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:13 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:14.612933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:14.613610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:14.620671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:14.621075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:14.622225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:14.622717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:14.787072 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:14.798520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7163117-3a38-49f4-b602-94edfc5d2e59 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.191007 May 27 16:30:14.801161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 128/238] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:14 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:15.818339 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:15.818946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:15.821370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:15.826564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:15.827011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:15.828324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:15.828923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:15.970345 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:15.978382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4c5ebb3b-59c7-45bd-9444-ff34607d32bf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1520 microversion: 2.1 time: 0.163876 May 27 16:30:15.988971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 111/239] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:15 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:16.996015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:16.996621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:17.003652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:17.004021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:17.004783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:17.005326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:17.150197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:17.160052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f70a7423-c829-42b8-be67-e84cdef9bf17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1500 microversion: 2.1 time: 0.167849 May 27 16:30:17.160843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 129/240] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:16 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:17.184911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:17.185590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:17.195026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:17.195471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:17.196238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:17.196669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:17.342082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:17.350528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1af2c234-9b1f-4be8-b6d9-81cfb8ec92ef tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1513 microversion: 2.1 time: 0.170276 May 27 16:30:17.351281 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 112/241] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:17 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:19.700964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:19.701953 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:19.709142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:19.709774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:19.710777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:19.711223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:19.740525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'flavor' on Instance uuid edc97e34-9888-4c3d-9ea1-226e97c009c9 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:30:20.334240 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eda93b51-8c4e-41b2-9894-e5f198cdf89e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/action" status: 200 len: 32 microversion: 2.1 time: 0.638824 May 27 16:30:20.337576 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 130/242] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:30:19 2022] POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/action => generated 32 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:30:20.344831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:20.346170 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:20.359929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:20.360373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:20.366599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:20.367293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:20.665773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:20.673591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-805fce35-c546-420f-a0f1-69fc07016459 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.332983 May 27 16:30:20.674901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 113/243] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:20 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:21.694256 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:21.694967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:21.702379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:21.702911 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:21.704614 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:21.705232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:21.887348 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:21.896203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4ce723d7-0ed3-4ef4-b965-9ba4b7c8a19a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.206758 May 27 16:30:21.901386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 131/244] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:21 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:22.914249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:22.915092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:22.921655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:22.922195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:22.923577 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:22.923981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:23.133807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:23.141628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5a57d099-74c7-49d2-9f3d-81e2e2e7f863 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.231509 May 27 16:30:23.142201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 114/245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:22 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:24.159413 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:24.160176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:24.167970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:24.168431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:24.169204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:24.169669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:24.353020 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:24.361005 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e580bc63-5e29-4b8b-af4b-b1497ccaec01 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.206036 May 27 16:30:24.371214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 132/246] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:24 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:25.379493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:25.381307 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:25.388493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:25.389302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:25.394707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:25.395519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:25.564595 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:25.573004 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4b5e18c8-487d-441a-90e4-fc2f887e67d7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.198372 May 27 16:30:25.573374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 115/247] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:25 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:26.160519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:26.161037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:26.168948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:26.168948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:26.169426 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:26.169864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:26.195814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-cf1dc0db-ead7-46f1-87df-c29ba43c38b4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/ips" status: 200 len: 152 microversion: 2.20 time: 0.039753 May 27 16:30:26.196712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 133/248] 10.222.0.42 () {60 vars in 1288 bytes} [Fri May 27 16:30:26 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 16:30:26.590120 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:26.590832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:26.597917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:26.598357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:26.599116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:26.599540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:26.765730 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:26.778602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e434ebcc-babd-44ff-9f2b-87dfe08d3327 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.192218 May 27 16:30:26.779200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 116/249] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:26 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:27.798844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:27.799455 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:27.807428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:27.808237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:27.820507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:27.820507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:27.956845 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:27.970127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-93962f39-347a-4cb4-b595-eb0780a0caa9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.173694 May 27 16:30:27.970127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 134/250] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:27 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:28.991166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:28.992317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:29.004645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:29.005533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:29.006874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:29.007659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:29.150691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:29.158866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7f9f019a-9f51-4418-bda9-6b8f2662140b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.175885 May 27 16:30:29.159460 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 117/251] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:28 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:29.611068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:29.611847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:29.619720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:29.620224 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:29.621006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:29.621643 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:29.656314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'flavor' on Instance uuid 491e3f1a-4810-4313-afad-ed811fb2bc9f {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:30:30.176293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:30.177118 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:30.185667 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:30.186649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:30.187578 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:30.188002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:30.346707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:30.354766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d36d47c1-78e0-47cc-b57b-209680a6a5e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.182390 May 27 16:30:30.355702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 118/252] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:30 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:30.547214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-24c258c3-2f70-4499-9a27-00ec1e076f11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/action" status: 202 len: 0 microversion: 2.20 time: 0.940508 May 27 16:30:30.547951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 135/253] 10.222.0.42 () {62 vars in 1318 bytes} [Fri May 27 16:30:29 2022] POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/action => generated 0 bytes in 942 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 16:30:30.558274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:30.561232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:30.567188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:30.567636 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:30.568441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:30.568877 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:30.719832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:30.728803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:30.730561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:30.732051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c6fef574-8190-4bbc-9e98-52c37c43c95d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.179255 May 27 16:30:30.732616 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 119/254] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:30 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:31.373107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:31.373987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:31.382221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:31.382676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:31.383552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:31.383997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:31.538817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:31.547435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-71b5f5df-8dd6-4cf9-8e48-b05bb744be1d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.178813 May 27 16:30:31.549010 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 136/255] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:31 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:31.757573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:31.758191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:31.766290 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:31.767233 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:31.768500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:31.768962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:31.904413 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:31.913277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:31.914790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:31.915947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-81715e92-2cd3-4d47-ae5c-873b48b9dce0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.162422 May 27 16:30:31.916502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 120/256] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:31 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:30:32.566349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:32.566898 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:32.569052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=40 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:32.573847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:32.577731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:32.577731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:32.577731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:32.709784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:32.717479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-dc647768-cf68-4f4a-a621-1682e12b2a8e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.156289 May 27 16:30:32.718050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 137/257] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:32 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:32.935007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:32.935620 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:32.942424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:32.942868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:32.943625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:32.944052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:33.074180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:33.083161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:33.084612 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:33.085798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a38d7d00-d3b0-455a-9cb5-8bbe7ba17699 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.154787 May 27 16:30:33.086376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 121/258] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:32 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:33.734525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:33.735056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:33.742471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:33.742924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:33.743685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:33.744118 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:33.884970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:33.893665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5b3d7729-9171-4000-8c71-2d9fac7576ff tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.162902 May 27 16:30:33.894245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 138/259] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:33 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:34.105486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:34.108856 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:34.114944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:34.115383 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:34.116137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:34.116564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:34.254103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:34.263079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:34.264699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:34.265896 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-34cd53cc-5676-477d-88e0-3eed1ef780ae tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.164462 May 27 16:30:34.266465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 122/260] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:34 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:34.912589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:34.913550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:34.921727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:34.926121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:34.926121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:34.926121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:35.113937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:35.134128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bca339bb-48e1-4380-aae4-490d08c4d27f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.226764 May 27 16:30:35.134720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 139/261] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:34 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:35.286043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:35.286653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:35.292657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:35.293231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:35.294080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:35.294589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:35.499868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:35.509807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:35.511304 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:35.512697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-da4350a4-131e-439e-9982-c24f23716fc0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.231367 May 27 16:30:35.513430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 123/262] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:35 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:36.152029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:36.152647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:36.159406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:36.160170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:36.165695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:36.166165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:36.323632 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:36.338012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:36.338012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-00eb00f3-8b87-4bbc-9932-948d25e15c03 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.184750 May 27 16:30:36.338012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 140/263] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:36 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:36.534060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:36.534953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:36.542659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:36.542849 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:36.543807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:36.544414 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:36.707879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:36.718324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:36.720016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:36.722138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-281e8c8c-aacf-43fc-905d-8f8af44b9614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.193934 May 27 16:30:36.722780 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 124/264] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:36 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:37.354727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:37.356687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:37.365209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:37.366707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:37.367554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:37.368172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:37.532431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:37.540508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-76e27b7b-412f-429a-936c-84c609aba32b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.191070 May 27 16:30:37.541588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 141/265] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:37 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:37.743214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:37.744136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:37.751242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:37.752140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:37.753107 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:37.753674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:37.962297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:37.974743 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:37.976900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:37.979054 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ec783c5f-9bb0-4394-bf4b-c552ceab1888 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.239346 May 27 16:30:37.979981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 125/266] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:37 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:38.557894 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:38.558567 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:38.567089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:38.567602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:38.568584 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:38.569037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:38.731065 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:38.756688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65b8da23-f81a-450f-93dc-517710aacba6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.202499 May 27 16:30:38.757300 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 142/267] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:38 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:38.999332 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:38.999864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:39.008159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:39.008680 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:39.009664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:39.010161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:39.159497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:39.168303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:39.176257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:39.176257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9bc1f27e-2f49-41c5-8629-046dbac45854 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.175699 May 27 16:30:39.176257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 126/268] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:38 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:39.774606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:39.775334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:39.781925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:39.782399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:39.784500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:39.784959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:39.925387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:39.933674 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-43951e64-8afa-436b-8a5c-5163009af141 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.163227 May 27 16:30:39.934562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 143/269] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:39 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:40.196491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:40.197695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:40.206070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:40.206618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:40.208786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:40.209671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:40.216978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:40.352810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:40.362622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:40.364293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:40.365482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-be60dd36-8529-4286-a2ff-e86dbf094d8e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.176354 May 27 16:30:40.366084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 127/270] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:40 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:40.954261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:40.957025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:40.968452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:40.968452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:40.968452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:40.968452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:41.100624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:41.108699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-05ec86bd-6ead-4d72-89e6-d3ac539dd828 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.158304 May 27 16:30:41.109264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 144/271] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:40 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:41.388725 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:41.389327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:41.397236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:41.397710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:41.398480 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:41.398906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:41.544622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:41.554253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:41.555749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:41.556908 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b3dc0ef3-122b-42ae-89a6-79d56a582d6d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.172187 May 27 16:30:41.557497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 128/272] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:41 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:30:42.127686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:42.129375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:42.137628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:42.138173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:42.139456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:42.139980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:42.294363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:42.301975 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2c44fe63-d318-4a82-a463-bb06163c640c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.179201 May 27 16:30:42.302543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 145/273] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:42 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:42.576711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:42.578032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:42.585951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:42.586941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:42.588471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:42.589049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:42.769196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:42.779327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:42.781058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:42.782343 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1bda799f-35db-4a25-b9ee-382df7125066 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.210072 May 27 16:30:42.782915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 129/274] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:42 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:43.320379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:43.320992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:43.327341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.327799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.328598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.329035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.470662 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:43.478931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f0dba52f-d5e7-4de8-acae-556ae1303073 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1499 microversion: 2.1 time: 0.162761 May 27 16:30:43.479736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 146/275] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:43 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:43.496041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eee9e855-ea38-4fb3-927c-5ea690721108"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:43.497187 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:43.505055 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.505541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.506325 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.506760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.535298 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] HTTP exception thrown: Cannot 'attach_volume' instance edc97e34-9888-4c3d-9ea1-226e97c009c9 while it is in vm_state rescued May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Request method failure captured: May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/os-volume_attachments HTTP/1.1 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 74 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxKnJ7-7LWepW6aA4PxHSDnHIjNyWGpXgH1-_edYrDmwcP9bdH7aKowr4kUdkSAX_jQmTs_X5pplHhTuQ4G43mr90Fk-w8GC-TOX1pCF3KDtCbKBjj7UM8tO2yntNq1ueoAF4tawQ7uDeXazOzw2c8K_YD2s9TfkMfOCsDx-4O1kgk May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:30:43.536880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6b6ae55c00cb4a43b8e2bc7df2ea9626", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: cf3e0adc32814585b57bf9f884840fc9 May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {"volumeAttachment": {"volumeId": "eee9e855-ea38-4fb3-927c-5ea690721108"}} May 27 16:30:43.538642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Cannot 'attach_volume' instance edc97e34-9888-4c3d-9ea1-226e97c009c9 while it is in vm_state rescued May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'server_id': 'edc97e34-9888-4c3d-9ea1-226e97c009c9', 'body': {'volumeAttachment': {'volumeId': 'eee9e855-ea38-4fb3-927c-5ea690721108'}}} May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:30:43.539698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance edc97e34-9888-4c3d-9ea1-226e97c009c9 while it is in vm_state rescued May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:30:43.541003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance edc97e34-9888-4c3d-9ea1-226e97c009c9 while it is in vm_state rescued May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Returning 409 to user: Cannot 'attach_volume' instance edc97e34-9888-4c3d-9ea1-226e97c009c9 while it is in vm_state rescued {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:30:43.542965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a5d4c656-77cb-4060-bcdb-c81cf15b5943 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046365 May 27 16:30:43.548038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:43.548610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:43.550709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 130/276] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:30:43 2022] POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 16:30:43.555443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.556094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.557053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.557683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.802749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:43.804650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:43.814306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.815164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.816242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.816883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.909921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2908e79e-45c0-46a3-accb-9ad0c802445a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/action" status: 202 len: 0 microversion: 2.1 time: 0.362060 May 27 16:30:43.910652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 147/277] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:30:43 2022] POST /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:30:43.922332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:43.926470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:43.935945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.936489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:43.937429 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:43.937955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:44.003636 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:44.012490 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:44.014125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:44.015300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d7aa5f04-0cc5-43e1-97f6-71ebde2c3d0a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.218400 May 27 16:30:44.015866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 131/278] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:43 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:30:44.113545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:44.121732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eb833fd1-0276-49a1-9e53-55ad2096e83f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1507 microversion: 2.1 time: 0.206453 May 27 16:30:44.122327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 148/279] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:43 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:44.781775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:44.782361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:44.792661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:44.793119 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:44.794183 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:44.794823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:44.829852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3d3ccccd-cc23-4d2a-8362-c06ebc529133 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/ips" status: 200 len: 146 microversion: 2.1 time: 0.054202 May 27 16:30:44.832683 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 132/280] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:30:44 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:45.035790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:45.036432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:45.042992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:45.043445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:45.044244 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:45.044768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:45.139054 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:45.139667 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:45.146557 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:45.147217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:45.147993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:45.148457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:45.206553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:45.216207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:45.217806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:45.219071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8f14573a-9cb8-4754-b4dc-8a65e6f9c123 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.188061 May 27 16:30:45.219972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 149/281] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:45 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:45.293372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:45.302412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1ba125cc-8715-4281-9d97-ad4b40da5226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1507 microversion: 2.1 time: 0.167259 May 27 16:30:45.303105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 133/282] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:45 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:46.241837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:46.242601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:46.249627 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:46.250096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:46.250922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:46.252430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:46.322657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:46.323511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:46.332014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:46.332268 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:46.333045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:46.333499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:46.479314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:46.498137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:46.500157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:46.501760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-edd2beaa-0334-46fb-aaa5-a27532a8d9a4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.264517 May 27 16:30:46.503751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 150/283] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:46 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:46.516163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:46.524466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-24a2dedd-b91e-48fe-8331-702aa01b4590 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1507 microversion: 2.1 time: 0.206306 May 27 16:30:46.525191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 134/284] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:46 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:30:47.522330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:47.522916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:47.529167 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:47.529663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:47.530435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:47.530871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:47.542599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:47.543204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:47.550874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:47.551314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:47.552111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:47.552536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:47.761700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:47.777437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:47.782553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:47.783952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:47.785482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5013acf7-de86-4b36-8c41-1a06fc43a1b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.267869 May 27 16:30:47.786244 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 151/285] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:47 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:47.793101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-37c3324b-59a1-4a9e-8696-f0150dd18352 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1507 microversion: 2.1 time: 0.254412 May 27 16:30:47.794885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 135/286] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:47 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:48.807982 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:48.809094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:48.812002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:48.813488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:48.823787 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:48.831990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:48.832152 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:48.832236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:48.832236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:48.832396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:48.833023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:48.833132 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:49.046257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:49.055129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-db2e74cf-065d-46ad-b119-781720073dc6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1513 microversion: 2.1 time: 0.246840 May 27 16:30:49.059145 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:49.061416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 136/287] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:48 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:49.067812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:49.068441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:49.076966 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:49.079610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:49.080978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-45ecbe8f-3259-4938-b9ba-835d072bfe45 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1743 microversion: 2.20 time: 0.278781 May 27 16:30:49.085134 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 152/288] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:48 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1743 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:49.085439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:49.086369 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:49.087296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:49.088427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:49.114750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c86fb826-4611-4ad4-8209-9fdccc9c45a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/ips" status: 200 len: 149 microversion: 2.1 time: 0.051794 May 27 16:30:49.115906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 137/289] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:30:49 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:50.104171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:50.104776 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:50.111364 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:50.111918 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:50.112925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:50.113381 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:50.301004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:50.322027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:50.322027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:50.324492 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6733b5de-a30a-40f1-9823-97b2c0167add tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1743 microversion: 2.20 time: 0.224210 May 27 16:30:50.326366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 153/290] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:50 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:50.326856 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50d0e9b6-b961-47dd-817c-7dd8f0ab0b30"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:50.327995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:50.334953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:50.335536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:50.336544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:50.336853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:51.349443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:51.350923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:51.360909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:51.361501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:51.362402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:51.362916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:51.517570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:51.539130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:51.540724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:51.542151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3d4a9a38-2d9c-498a-b2c0-c11b4b2b9744 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.199881 May 27 16:30:51.562220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 154/291] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:51 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:52.015339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-17a0a00f-b046-4dd3-a0af-4d744be1ae91 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: .version_select at 0x7f0e99fc43a0>, body: {"keypair": {"name": "tempest-keypair-2107511489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd99p/ro4whsvxBqBwAVfL9wBOC7ODOLrmg+0n6yl5+Fampjc4SAmCbksgsWM4s/VDLVEELoTY/rRKDf22ohc2Mdzm/N/qIgVDziGelKI+krvpHkvdOSV4ASXkmyal8cw=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:52.030605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-17a0a00f-b046-4dd3-a0af-4d744be1ae91 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:30:52.036805 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-17a0a00f-b046-4dd3-a0af-4d744be1ae91 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for user cf3e0adc32814585b57bf9f884840fc9 and project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:30:52.214438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-17a0a00f-b046-4dd3-a0af-4d744be1ae91 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204353 May 27 16:30:52.216263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 155/292] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:30:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:52.261942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-406bd47a-783d-4088-a970-1501f4b85fc4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.949358 May 27 16:30:52.279200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 138/293] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:30:50 2022] POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments => generated 194 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:52.593965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:52.595847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:52.613821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:52.623683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:52.628849 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:52.630307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:52.887919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-c33e26c5-af77-4c54-821a-3b8c67a147e2 req-b3ce2e16-7d27-4760-ae3d-c891b0e01c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "name": "network-vif-plugged", "status": "completed", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:52.892128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=56 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:52.916472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c33e26c5-af77-4c54-821a-3b8c67a147e2 req-b3ce2e16-7d27-4760-ae3d-c891b0e01c66 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:52.917814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c33e26c5-af77-4c54-821a-3b8c67a147e2 req-b3ce2e16-7d27-4760-ae3d-c891b0e01c66 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:52.962216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:52.962909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-c33e26c5-af77-4c54-821a-3b8c67a147e2 req-b3ce2e16-7d27-4760-ae3d-c891b0e01c66 service nova] Creating event network-vif-plugged:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:30:52.998141 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-c33e26c5-af77-4c54-821a-3b8c67a147e2 req-b3ce2e16-7d27-4760-ae3d-c891b0e01c66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115003 May 27 16:30:52.999728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 139/294] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:53.013813 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:53.017745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:53.019919 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a96c4fe3-e74d-4aab-9d06-9470f7c38e50 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.444819 May 27 16:30:53.031636 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 156/295] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:52 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:53.250345 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73580451-62d0-415e-ac60-bba51dc95385"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:53.251765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:53.263982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:53.264554 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:53.265300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:53.270498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:54.039721 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:54.041142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:54.080664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:54.081103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:54.094278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:54.095203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:54.161735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:54.428118 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:54.439406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:54.443992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:54.445623 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-15d42e28-9793-42b3-8fd5-239e4a3458d8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.410558 May 27 16:30:54.446691 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 157/296] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:54 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:54.729164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a597fe40-ced7-4f67-8bb0-2fe97afa4bb3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.490949 May 27 16:30:54.740720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 140/297] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:30:53 2022] POST /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments => generated 194 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:30:55.467344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:55.468651 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:55.489773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:55.494977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:55.494977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:55.494977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:55.817692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:55.826576 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:55.828393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:55.830023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6f68e472-c573-4f4d-bf20-cd31a8b8896a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.366694 May 27 16:30:55.831694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 158/298] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:55 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:30:56.850197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:56.850919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:56.858193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:56.858641 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:56.859410 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:56.859844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:57.020835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:57.029661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:57.031399 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:57.032548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9ebece84-5ba2-45d0-ab4e-8ebd4146c9bc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.186919 May 27 16:30:57.033099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 141/299] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:56 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:57.560498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1457759746", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b4aa0c1-80e2-4655-bb67-93c62e39df1f"}], "security_groups": [{"name": "tempest-securitygroup--2111760368"}], "key_name": "tempest-keypair-2107511489", "user_data": "}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:30:57.757544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] validate_networks() for [('4b4aa0c1-80e2-4655-bb67-93c62e39df1f', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:30:58.054257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:58.055467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:58.088802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:58.091694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:58.092722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:58.093165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:58.439052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:58.444022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:58.456270 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:58.458215 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:58.460598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4732f59b-c340-47d2-b539-620607fbb314 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.413102 May 27 16:30:58.462025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 142/300] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:58 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:30:58.680038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:30:58.680896 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:30:58.680984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:30:58.681676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:30:58.682075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:30:58.709680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:58.710133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:58.717228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:58.718648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:58.780102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:30:58.785861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Getting quotas for user cf3e0adc32814585b57bf9f884840fc9 and project 6b6ae55c00cb4a43b8e2bc7df2ea9626. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:30:58.801907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:30:58.806544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:30:59.156861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b4a33f37-325a-4074-a267-e52214fb708e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.600898 May 27 16:30:59.158200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 159/301] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:30:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:30:59.168842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-842ca94d-20fd-434b-bb53-f6844ed8eec6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:59.173370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-842ca94d-20fd-434b-bb53-f6844ed8eec6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:59.259289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-842ca94d-20fd-434b-bb53-f6844ed8eec6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:59.278225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-842ca94d-20fd-434b-bb53-f6844ed8eec6 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1246 microversion: 2.1 time: 0.113966 May 27 16:30:59.288356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 143/302] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:30:59 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:30:59.486685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:30:59.486685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:30:59.493724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:59.494183 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:59.494969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:30:59.495407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:30:59.789666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:59.802172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:59.805234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:30:59.806684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-478d0f16-3a73-4ab9-bce2-4c5468eee083 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.330345 May 27 16:30:59.818026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 160/303] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:30:59 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:00.301453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5d527234-bc0f-4067-aee6-7a08cf3b3cd3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:00.304003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5d527234-bc0f-4067-aee6-7a08cf3b3cd3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:00.492604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5d527234-bc0f-4067-aee6-7a08cf3b3cd3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:00.509444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5d527234-bc0f-4067-aee6-7a08cf3b3cd3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1246 microversion: 2.1 time: 0.210988 May 27 16:31:00.511654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 144/304] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:00 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1246 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:00.828221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:00.829760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:00.838985 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:00.839439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:00.840514 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:00.841142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:01.483096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:01.491179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e1b155e5-a8b9-4864-8c0a-364f39447ffc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:01.510404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:01.519540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:01.519540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e8104e77-8510-4861-b6f8-8b35803be587 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.690428 May 27 16:31:01.519778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1b155e5-a8b9-4864-8c0a-364f39447ffc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:01.519778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e1b155e5-a8b9-4864-8c0a-364f39447ffc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:01.535551 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 161/305] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:00 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:01.540459 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:01.541129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:01.567987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:01.568689 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:01.572246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:01.573043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:01.713635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:01.720807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e1b155e5-a8b9-4864-8c0a-364f39447ffc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Going to try to stop instance {{(pid=118487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 16:31:01.736910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-84adf8fe-06c1-4eac-aedf-ec1aebe12164 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1250 microversion: 2.1 time: 0.192954 May 27 16:31:01.748185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 162/306] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:01 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1250 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:02.049500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e1b155e5-a8b9-4864-8c0a-364f39447ffc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.574532 May 27 16:31:02.056035 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 145/307] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:31:01 2022] POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:31:02.086528 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:02.087917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:02.099676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.100123 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.100899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.101334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.243124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:02.252800 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-19415173-a89f-40dd-b2de-28f4a91a8913 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.184110 May 27 16:31:02.254385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 163/308] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:02 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:02.537302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:02.538015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:02.545097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.545880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.546777 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.547278 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.734808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:02.746150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:02.748783 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:02.750393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6f351dd1-84fe-409f-8981-7230c932d1e9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.217961 May 27 16:31:02.751640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 146/309] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:02 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:02.755856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:02.756454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:02.763056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.763692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.764628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:02.765076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:02.836829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:02.844971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-db28c86b-d82e-4ef3-b297-5bc3be41ca61 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1242 microversion: 2.1 time: 0.093149 May 27 16:31:02.845798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 164/310] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:02 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:03.276950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:03.278273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:03.292499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.294435 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:03.297086 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.299424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:03.548009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:03.587193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-854f1ab1-e315-42ce-a362-aa77e56c5486 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.316799 May 27 16:31:03.587193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 147/311] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:03 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:03.769518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:03.770566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:03.773616 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:03.778847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.782064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:03.782064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.782064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:03.864074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:03.864687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:03.879173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.880272 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:03.882706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:03.883163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:04.188989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:04.206546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1bc9dd1b-a348-4d00-a5c7-500c5bac2a48 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1298 microversion: 2.1 time: 0.347000 May 27 16:31:04.210432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 148/312] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:03 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1298 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:04.267190 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:04.284551 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:04.290592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:04.294933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7cce843-4abf-43ee-82c6-9e69ac225730 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.529937 May 27 16:31:04.296180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 165/313] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:03 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:04.615676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:04.615676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:04.633208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:04.634041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:04.635253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:04.635702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:05.229853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:05.230469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:05.247962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:05.250423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:05.250423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:05.252629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:05.303277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:05.317416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ffeccb37-1f0c-425e-9b15-0044d243f71b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.717294 May 27 16:31:05.318303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 149/314] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:04 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:05.334104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:05.354679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:05.373678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:05.374303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:05.375270 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:05.375863 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:05.438950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:05.459175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-29534796-c4bd-434c-bd05-1ccab8a8ba29 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1304 microversion: 2.1 time: 0.236268 May 27 16:31:05.465410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 166/315] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:05 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:05.918642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:05.950069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:05.952059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:05.975981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-aeac8744-ade3-4967-acd2-0ebc7a2d8263 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.647313 May 27 16:31:05.989627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 150/316] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:05 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:06.336227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:06.336857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:06.347157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:06.358452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:06.359320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:06.359772 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:06.482551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:06.483164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:06.503997 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:06.504741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:06.507214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:06.510840 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:07.004587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:07.025256 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1b2f4a8e-b9aa-444e-b4d4-680c044647c3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.685533 May 27 16:31:07.026910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 167/317] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:06 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:07.033489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:07.035522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:07.039010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:07.057280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2da2dce8-82aa-4eb6-a5fc-d029d29661af tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.578372 May 27 16:31:07.077274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 151/318] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:06 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:07.077516 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:07.085134 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:07.086867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:07.095270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:08.056538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:08.058200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:08.079573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:08.080625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:08.082501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:08.088081 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:08.754521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:08.799843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:08.927665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:08.953116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:08.956242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:08.963824 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-71be4c8f-07e0-4e25-b58f-fd87708775e5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 1.935186 May 27 16:31:08.970138 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 168/319] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:07 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:08.980008 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:08.980977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:08.995283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:08.995749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:08.996609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:09.000366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:09.079925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:09.102561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2603db0c-e7c1-4d62-927e-3af92b247af9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 1.058833 May 27 16:31:09.108361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 152/320] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:08 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:09.643745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:09.657884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2f958e37-2f74-4bb7-93fe-c823a3112620 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.686377 May 27 16:31:09.661642 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 169/321] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:08 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:09.985320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:09.985984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:10.000978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:10.001456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:10.029864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:10.036676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:10.141206 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:10.142712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:10.154249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:10.159331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:10.160464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:10.161424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:10.504628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=4 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:11.155194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:11.168883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:11.174146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:11.175398 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cadbf50e-8601-4917-a950-f5f2bbdf387a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 1.195273 May 27 16:31:11.180165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 153/322] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:09 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:11.185031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-f3e882ff-3d69-423f-a7e6-2e0491ca1401 req-2f963f94-6630-40ae-84df-ce51b82213be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:11.206449 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:11.211673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-f3e882ff-3d69-423f-a7e6-2e0491ca1401 req-2f963f94-6630-40ae-84df-ce51b82213be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:11.212206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-f3e882ff-3d69-423f-a7e6-2e0491ca1401 req-2f963f94-6630-40ae-84df-ce51b82213be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:11.218375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d13065c4-97e3-417a-8809-0032076563ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 1.082682 May 27 16:31:11.219636 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 170/323] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:10 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:11.226868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:11.227870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:11.238103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:11.240025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:11.242078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:11.242701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:11.255901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-f3e882ff-3d69-423f-a7e6-2e0491ca1401 req-2f963f94-6630-40ae-84df-ce51b82213be service nova] Creating event network-changed:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:31:11.266929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-f3e882ff-3d69-423f-a7e6-2e0491ca1401 req-2f963f94-6630-40ae-84df-ce51b82213be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085210 May 27 16:31:11.270523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 154/324] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:11.284474 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cf64042f-4957-400e-9339-d5b99e470cfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: .version_select at 0x7f0e99743b80>, body: {"keypair": {"name": "tempest-keypair-1467720525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/SW0Lr9+77gQid2QHJARGkMF73PMcZ5SgK2gDhcMkA+0D2k+MMDPv4UsiJLUxGNNTRd5LpeKI6gEfmd7E9QOPS9fX/9WyEOCC3YrQ3G45VWHs/uwEy3aKTXip3mrQkNw=="}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:11.327669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-cf64042f-4957-400e-9339-d5b99e470cfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:31:11.341857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-cf64042f-4957-400e-9339-d5b99e470cfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:31:11.536584 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:11.548714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-375541b9-c6b3-4d25-841b-45e2adc4e1b5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.327205 May 27 16:31:11.552767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 171/325] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:11 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:11.569150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1465227082", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "networks": [{"uuid": "4600418a-b3f7-4bdf-b9ec-b57285402638"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:11.676897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cf64042f-4957-400e-9339-d5b99e470cfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.404428 May 27 16:31:11.685844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 155/326] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:31:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:11.729501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] validate_networks() for [('4600418a-b3f7-4bdf-b9ec-b57285402638', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:31:12.207505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:12.210826 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:12.220926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.223816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.224841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.225467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.549962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:31:12.550404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:31:12.553575 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:31:12.557391 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:31:12.560160 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:31:12.641659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.645530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.651252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.651252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.685751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:12.698360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:12.708057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:12.719257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-51ae94c2-35cb-4f6c-b71a-1c24811819cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.517826 May 27 16:31:12.731446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 156/327] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:12 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:12.764849 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:12.766080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:12.823250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Getting quotas for project e1194991899d4dd5ac974608165516b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:31:12.827821 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.833626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.834722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:12.835511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:12.860782 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Getting quotas for user 97c3e6bd775848f39176015d42749fa2 and project e1194991899d4dd5ac974608165516b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:31:12.918984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:31:12.936144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:31:13.225202 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-392bda85-8c3e-4703-b0e0-528f4efa286b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666852 May 27 16:31:13.228227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 172/328] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:31:13.255503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:13.255503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:13.345635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:13.361601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:13.369788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:13.370576 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:13.407371 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:13.422242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-32fb86e2-2038-474c-a3c1-4f92a0a6fd56 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.689163 May 27 16:31:13.426860 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 157/329] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:12 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:13.439864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-205b0be5-853f-4196-a90d-29a6491f11b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:13.440732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-205b0be5-853f-4196-a90d-29a6491f11b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:13.627666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-205b0be5-853f-4196-a90d-29a6491f11b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:13.638914 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-205b0be5-853f-4196-a90d-29a6491f11b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1214 microversion: 2.1 time: 0.210212 May 27 16:31:13.644546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 158/330] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:13 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:13.740657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:13.741595 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:13.751925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:13.752375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:13.753180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:13.753613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:13.974904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:13.982466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7c7ccb32-4a44-4735-80e2-c246b318d910 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.749924 May 27 16:31:13.983456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 173/331] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:13 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:14.131380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:14.142537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:14.145439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:14.147140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9cdc6fe9-9911-4cc0-b014-fc0da46a38cb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.410488 May 27 16:31:14.148277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 159/332] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:13 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:14.445305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:14.446321 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:14.479311 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:14.481150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:14.486378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:14.487935 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:14.659907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-66f628e1-8e06-43ce-be71-6c0133123622 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:14.660913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-66f628e1-8e06-43ce-be71-6c0133123622 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:14.839089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:14.853719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-30474583-02eb-48a0-aa4c-96566c58b924 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.413866 May 27 16:31:14.862437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 174/333] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:14 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:14.862626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-66f628e1-8e06-43ce-be71-6c0133123622 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:14.883855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-66f628e1-8e06-43ce-be71-6c0133123622 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1214 microversion: 2.1 time: 0.217494 May 27 16:31:14.887936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 160/334] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:14 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:15.003999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:15.009270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:15.017890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.018624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.019657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.021400 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.042314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:15.175003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:15.176281 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:15.186324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.192391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.194869 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.197318 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.648969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:15.670170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-81603118-b0ac-4172-bd5a-f25a3ae0ce17 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.667139 May 27 16:31:15.671339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 175/335] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:14 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:15.768528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:15.782755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:15.784547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:15.786740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b274d6b7-e044-41d7-b96d-1967cc729ed0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1738 microversion: 2.20 time: 0.625095 May 27 16:31:15.787265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 161/336] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:15 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1738 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:15.882503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:15.883428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:15.900217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.901467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:15.902083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:15.902897 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.903950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.906086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.908699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.909141 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:15.911177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:15.912464 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:16.080664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:16.102716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0ce05a07-0f3b-4d06-9e30-20119bcd9323 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1218 microversion: 2.1 time: 0.204464 May 27 16:31:16.103945 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 162/337] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:15 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:16.309519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:16.321432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9be2149a-da69-43f0-b225-5c791fcc6085 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.443505 May 27 16:31:16.334825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 176/338] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:15 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:16.689138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:16.690577 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:16.708436 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:16.714095 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:16.714095 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:16.714095 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:16.813866 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:16.814809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:16.826565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:16.827011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:16.831098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:16.831570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.156071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.165276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-da41bfaa-f1e5-4985-b9f5-0695dce4fa21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.481039 May 27 16:31:17.166515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 163/339] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:16 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:17.172045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:17.173381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:17.181257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:17.181823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.183772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:17.183772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.187726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:17.236356 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.247799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.249303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.250959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ff996b5b-adbf-4fb8-8431-6ce0710c9979 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1720 microversion: 2.20 time: 0.448181 May 27 16:31:17.251668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 177/340] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:16 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1720 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:17.322103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.329751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9c897e39-ee4d-499b-9f60-a69d8fef8552 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1266 microversion: 2.1 time: 0.161855 May 27 16:31:17.340605 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 164/341] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:17 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:17.341379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:17.342025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:17.371685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:17.372198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.373041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:17.373701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.546485 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-5a770d21-e789-4b37-a72c-37436d0cfcbd req-afc22fbb-2403-41bd-bd45-62c11c39d836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "name": "network-vif-plugged", "status": "completed", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:17.571111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5a770d21-e789-4b37-a72c-37436d0cfcbd req-afc22fbb-2403-41bd-bd45-62c11c39d836 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:17.571886 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5a770d21-e789-4b37-a72c-37436d0cfcbd req-afc22fbb-2403-41bd-bd45-62c11c39d836 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:17.592492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-5a770d21-e789-4b37-a72c-37436d0cfcbd req-afc22fbb-2403-41bd-bd45-62c11c39d836 service nova] Creating event network-vif-plugged:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:31:17.618741 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:17.619952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-5a770d21-e789-4b37-a72c-37436d0cfcbd req-afc22fbb-2403-41bd-bd45-62c11c39d836 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076982 May 27 16:31:17.620562 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 165/342] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:31:17.632641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e9e09435-d3c8-4f41-8072-353251739b42 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.296191 May 27 16:31:17.633979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 178/343] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:17 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:17.970555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-802953408", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6206a18c-fdfb-4556-905d-212faa509374"}], "security_groups": [{"name": "tempest-securitygroup--728597957"}], "key_name": "tempest-keypair-1467720525", "user_data": "}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:18.093942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] validate_networks() for [('6206a18c-fdfb-4556-905d-212faa509374', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:31:18.185464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:18.194249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:18.195241 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.196622 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.199187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.200168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.452422 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:18.472687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-206b8321-cd3c-4802-a4e5-ebd209fe4db9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.291001 May 27 16:31:18.483764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 179/344] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:18 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:18.483951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:18.485687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:18.505504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.508192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.517712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.518175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.776719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:31:18.778048 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:31:18.778598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:31:18.779372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:31:18.779521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:31:18.791993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.792427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.793560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.794776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.805168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:18.817779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:31:18.831763 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:18.831763 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:18.832004 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:31:18.832173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e74136b9-e19d-4196-8e31-9eb820b026ba tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1720 microversion: 2.20 time: 0.344585 May 27 16:31:18.832173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 180/345] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:18 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:18.832173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:18.832173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:18.837796 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.838307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.839085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.839518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.849779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:31:18.854248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:31:18.915022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:18.923141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-50196ba0-1021-4a45-aafd-fd11b982d2b8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1266 microversion: 2.1 time: 0.097840 May 27 16:31:18.933303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 181/346] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:18 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:18.938732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:18.939551 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:18.946350 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.946803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:18.947580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:18.948012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.074200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-34814be4-7707-471c-96c0-841f42aa66a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.117599 May 27 16:31:19.079713 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 166/347] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:31:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:31:19.092276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6c220110-c13f-478b-92b0-4f7240881bd4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:19.094300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6c220110-c13f-478b-92b0-4f7240881bd4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:19.160684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:19.187062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-504eea84-c9e5-46f5-9bad-7d76d690a2c9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.241511 May 27 16:31:19.189257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 182/348] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:18 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:19.253851 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6c220110-c13f-478b-92b0-4f7240881bd4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:19.265145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6c220110-c13f-478b-92b0-4f7240881bd4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1241 microversion: 2.1 time: 0.180918 May 27 16:31:19.266338 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 167/349] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:19 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:19.490715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:19.492229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:19.504711 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.505528 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.505960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.506387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.838736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:19.843558 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:19.844455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:19.846695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ccfb7123-9abe-4c02-ad4b-03ccba25a0db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.359823 May 27 16:31:19.856380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.856948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.860455 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 183/350] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:19 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:19.865006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.865559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.949510 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:19.950131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:19.973857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.985815 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:19.990349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:19.992803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.268055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.274254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-684b5d3b-1679-4764-9fde-fe8ebef05d2e tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1284 microversion: 2.1 time: 0.337531 May 27 16:31:20.278278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 184/351] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:19 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1284 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:20.283268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:20.283859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:20.302724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.303197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.303973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.304410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.368105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.386301 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.388317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.394121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-abff1c7a-a2e0-4a5b-99d3-3a75ed6e05a9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1723 microversion: 2.20 time: 0.555650 May 27 16:31:20.406228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 168/352] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:19 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1723 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:20.428354 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a6725907-acc0-4811-a019-6a0e83b6250b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:20.430854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a6725907-acc0-4811-a019-6a0e83b6250b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:20.571647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a6725907-acc0-4811-a019-6a0e83b6250b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.579029 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a6725907-acc0-4811-a019-6a0e83b6250b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1241 microversion: 2.1 time: 0.156326 May 27 16:31:20.589312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 169/353] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:20 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1241 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:20.600974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e802274-1a3b-4ed4-a80e-f81c3471acdd"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:20.605747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:20.615142 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:20.617093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.617567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.618335 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.618760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.695752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:20.710500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1ec79b68-0384-4109-973f-77497b2df36a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.430706 May 27 16:31:20.722133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 185/354] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:20 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:20.871646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:20.872183 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:20.881215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.882229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:20.888442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:20.888442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.062089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:21.071149 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6b9e1805-fb7a-4f56-8aab-a25fbaf2d585 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.206077 May 27 16:31:21.071734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 186/355] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:20 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:21.266142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-1bf2a2e8-0155-4e0d-9911-ecf3fffa04cb req-6096d532-f6a1-42d1-8fe2-f65e7e09d56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "name": "network-vif-unplugged", "status": "completed", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:21.287482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-1bf2a2e8-0155-4e0d-9911-ecf3fffa04cb req-6096d532-f6a1-42d1-8fe2-f65e7e09d56b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.287961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-1bf2a2e8-0155-4e0d-9911-ecf3fffa04cb req-6096d532-f6a1-42d1-8fe2-f65e7e09d56b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.303977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.compute.server_external_events [req-1bf2a2e8-0155-4e0d-9911-ecf3fffa04cb req-6096d532-f6a1-42d1-8fe2-f65e7e09d56b service nova] Unable to find a host for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f. Dropping event network-vif-unplugged {{(pid=118488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 16:31:21.306040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-1bf2a2e8-0155-4e0d-9911-ecf3fffa04cb req-6096d532-f6a1-42d1-8fe2-f65e7e09d56b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044111 May 27 16:31:21.308944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 187/356] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 16:31:21.314032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:21.314650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:21.326644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.327236 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.328043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.328477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.547232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:21.560146 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7a103bf6-7034-409a-9b5b-4508e95d07ef tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.249862 May 27 16:31:21.561888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 188/357] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:21 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:21.596689 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:21.597458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:21.605391 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.606152 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.607101 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.607536 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.674561 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:21.686242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-76a9d1b6-0222-465d-8c02-f6a048da1bd3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1237 microversion: 2.1 time: 0.093787 May 27 16:31:21.687833 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 189/358] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:21 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:21.732529 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:21.734209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:21.743941 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.743941 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:21.744820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:21.745637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.176164 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:22.184484 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-14dbffd0-9920-4642-ac3d-2fc1e059883e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.458064 May 27 16:31:22.185143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 190/359] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:21 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:22.191163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:22.192265 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:22.198544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.199077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.199986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.200490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.346301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:22.355690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c046ad29-beb8-4a4c-bf2f-b20dc46fed85 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.169387 May 27 16:31:22.356482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 191/360] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:22 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:22.462952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a3bc9010-ef6e-45e1-961c-624fb5c16b04 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.872282 May 27 16:31:22.468741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 170/361] 10.222.0.42 () {62 vars in 1363 bytes} [Fri May 27 16:31:20 2022] POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments => generated 188 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:31:22.578475 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:22.579222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:22.596185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.596799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.598139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.598139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.601736 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:22.602496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:22.611147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.611834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.612778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.613433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.728687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:22.840950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:22.843978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:22.850839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ed8ca9ef-6e10-4d45-98ef-bfcf549ab580 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.276334 May 27 16:31:22.857634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 192/362] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:22 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:22.862056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:22.862770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:22.870615 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.871185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.872064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.872562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.903559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:22.961094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5462d80d-2468-4ba2-bbde-eed2cd90d9da tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/action" status: 202 len: 0 microversion: 2.20 time: 0.364390 May 27 16:31:22.962637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:22.968638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 171/363] 10.222.0.42 () {62 vars in 1318 bytes} [Fri May 27 16:31:22 2022] POST /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 16:31:22.977730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-236ac0ad-6cb8-40fc-a63d-66901d5e7e25 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1237 microversion: 2.1 time: 0.124655 May 27 16:31:22.978961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 193/364] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:22 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1237 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:22.980348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:22.982918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:22.994819 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.995660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:22.996668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:22.997567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.196243 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:23.203226 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:23.204135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:23.208966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:23.210700 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:23.211987 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f905296e-c293-4291-902e-1d1b02588cdb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1749 microversion: 2.20 time: 0.242020 May 27 16:31:23.214131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.214948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 172/365] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:22 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1749 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:23.216180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.217001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.217548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.375824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:23.376622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:23.385365 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.386992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.388398 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.389004 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.452738 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:23.463422 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0978ad25-8159-4ce8-b642-a9c90aa8b9e7 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.264698 May 27 16:31:23.464350 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 194/366] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:23 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:23.618367 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:23.627236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e5a8944c-80d5-4044-8a7d-76034d924cfb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.257884 May 27 16:31:23.628136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 173/367] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:23 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:23.870503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:23.871879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:23.883502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.884851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.885855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:23.887111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:23.996817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:23.997463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:24.013674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.014726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.017133 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.017748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.162646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:24.182634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ab933671-f7e3-4652-9798-b3ea626bbf4c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1237 microversion: 2.1 time: 0.185930 May 27 16:31:24.183949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 174/368] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:23 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1237 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:24.198858 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:24.207654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-acb0b7a1-b8b6-4d6d-95b8-9aa2454bb5ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.342930 May 27 16:31:24.208717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 195/369] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:23 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:24.240406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:24.240406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:24.244398 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.244905 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.245972 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.246514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.485911 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:24.487078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:24.496760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.498045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.499639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.500544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.555047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:24.575165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:24.577058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:24.578394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fb5b95b8-9ccd-4eb1-b267-cc06100929c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1749 microversion: 2.20 time: 0.348728 May 27 16:31:24.587424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 175/370] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:24 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1749 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:24.644561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:24.646569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:24.652790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.659493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:24.659493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:24.659493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.040407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:25.051295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f785c4d6-4eb6-4934-9d1b-00fced76c015 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.573108 May 27 16:31:25.052346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 196/371] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:24 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:25.067571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:25.075077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-55d2a699-3e68-4638-8e26-07631d48dc7c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1372 microversion: 2.1 time: 0.434716 May 27 16:31:25.075652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 176/372] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:24 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1372 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:25.201187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:25.201978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:25.213218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.213218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.213218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.213218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.225863 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:25.226826 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:25.234780 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.235430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.236351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.236959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.389235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:25.397156 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6fd8c918-f31d-4271-af40-c22f4f9a7b01 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1293 microversion: 2.1 time: 0.200989 May 27 16:31:25.397850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 197/373] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:25 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:25.583676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:25.591720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6fdec827-95d1-4fea-820e-40712b0a16ff tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.370378 May 27 16:31:25.603952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:25.611332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:25.614728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 177/374] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:25 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:25.618091 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.618748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:25.620397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:25.620983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.076153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:26.077466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:26.106129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.108419 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.109498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.110189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.199297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.217675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.218793 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.220168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c7b445ba-c958-4ccd-bb45-808a06245610 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.626755 May 27 16:31:26.221212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 198/375] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:25 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:26.235296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:26.237886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:26.246043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.246742 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.247676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.248392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.478528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.487286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-12e86094-e849-4b34-8418-96b9e848db00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.415539 May 27 16:31:26.487986 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 178/376] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:26 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:26.493112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:26.494528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:26.501496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.501949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.502760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.503197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.596821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.604751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5b7a8431-6aec-4607-87d5-28a888cb0ecb tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1565 microversion: 2.1 time: 0.381783 May 27 16:31:26.608109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.611089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 199/377] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:26 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1565 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:26.617021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-e86ea9b0-306b-4978-9141-1bee84854670 req-bf64ddef-facc-4b67-8153-60bff7ae73a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd5e49e-af80-42b8-9706-6809abc10d9c", "tag": "047fee43-35eb-4d21-b702-885e4f5d2c79"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:26.626808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f0edc9db-44ac-413d-9ac1-19ac5e5793a1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1311 microversion: 2.1 time: 0.137816 May 27 16:31:26.627954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 179/378] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:26 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:26.633501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:26.639153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-e86ea9b0-306b-4978-9141-1bee84854670 req-bf64ddef-facc-4b67-8153-60bff7ae73a8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.639599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-e86ea9b0-306b-4978-9141-1bee84854670 req-bf64ddef-facc-4b67-8153-60bff7ae73a8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.642985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:26.651043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.657010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.658191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.658715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.665668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-e86ea9b0-306b-4978-9141-1bee84854670 req-bf64ddef-facc-4b67-8153-60bff7ae73a8 service nova] Creating event network-changed:047fee43-35eb-4d21-b702-885e4f5d2c79 for instance bcd5e49e-af80-42b8-9706-6809abc10d9c on hv-cinder-84049 May 27 16:31:26.678466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-e86ea9b0-306b-4978-9141-1bee84854670 req-bf64ddef-facc-4b67-8153-60bff7ae73a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065808 May 27 16:31:26.680363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:26.680739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 200/379] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:26.687380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:26.688821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:26.697193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.704343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.704343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:26.704343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:26.807429 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-86fc894f-d7fd-4fc2-b8e1-6d60af0a4783 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125089 May 27 16:31:26.808395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 201/380] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:31:26 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:26.950861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:26.965322 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2d8f528a-7ec7-4fb0-a1d7-240eba5ac2e4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.335285 May 27 16:31:26.966180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 180/381] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:26 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:27.243688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:27.244885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:27.251476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.252151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.253546 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.254139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.450346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:27.460656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:27.462409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:27.463920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0fd8632b-c5db-47e2-b957-64466bd49433 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.225302 May 27 16:31:27.464819 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 202/382] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:27 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:27.506847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:27.507595 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:27.514665 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.515082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.515841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.516302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.674451 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:27.675235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:27.688732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.692821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.694380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.694991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.836093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:27.852343 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-97138993-b442-4ea0-9c54-c9018c4dd011 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.350247 May 27 16:31:27.853254 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 181/383] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:27 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:27.874330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:27.885436 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d6172242-6ac3-407b-826c-da0f18606ce7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1299 microversion: 2.1 time: 0.228902 May 27 16:31:27.888589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 203/384] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:27 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:27.983242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:27.983861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:27.991502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.993154 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:27.994455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:27.995053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.282125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:28.295918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-81327596-bf59-4f2b-9e9a-c89af99bd03c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.316737 May 27 16:31:28.296511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 182/385] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:27 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:28.483509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:28.485041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:28.499354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.503290 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.504352 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.509493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.699999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-e632143a-e290-45c4-904e-0157177b9b31 req-baea7ad0-c6d9-4f42-ad59-d96e9815f8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:28.717786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-e632143a-e290-45c4-904e-0157177b9b31 req-baea7ad0-c6d9-4f42-ad59-d96e9815f8be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.718250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-e632143a-e290-45c4-904e-0157177b9b31 req-baea7ad0-c6d9-4f42-ad59-d96e9815f8be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.745008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-e632143a-e290-45c4-904e-0157177b9b31 req-baea7ad0-c6d9-4f42-ad59-d96e9815f8be service nova] Creating event network-changed:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:31:28.769154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:28.770065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-e632143a-e290-45c4-904e-0157177b9b31 req-baea7ad0-c6d9-4f42-ad59-d96e9815f8be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065998 May 27 16:31:28.771058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 183/386] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:28.780597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:28.782635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:28.784100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e6ba4584-cbdd-4127-aafd-63a048efef49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.304734 May 27 16:31:28.785972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 204/387] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:28 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:28.871787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:28.872751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:28.874786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:28.880903 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.881632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.882586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.883217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.908820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:28.909758 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:28.919303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.934556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:28.937129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:28.939970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:29.101614 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:29.128961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e1d0465b-7ee6-40d3-a9fe-a610650c0b91 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1299 microversion: 2.1 time: 0.218801 May 27 16:31:29.134054 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 205/388] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:28 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:29.315249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:29.318835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:29.332475 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:29.336272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:29.337454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:29.338087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:29.362498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:29.382350 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-45a1e1e9-e80b-4040-b008-2d86a876dc00 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.514782 May 27 16:31:29.394152 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 184/389] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:28 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:29.804149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:29.804762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:29.830639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:29.841239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-caf56542-c67d-4364-a521-9b38a9e187f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.531761 May 27 16:31:29.841854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:29.842330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:29.843333 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:29.844887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:29.845895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 206/390] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:29 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:30.095494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:30.109394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:30.116346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:30.123993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-321f1fa9-1d7f-4773-bbef-e9997fd83ebe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.323302 May 27 16:31:30.124739 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 185/391] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:29 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:30.151215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:30.152274 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:30.183665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:30.183882 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:30.184668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:30.185108 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:30.317967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:30.326356 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-144331b1-9e18-4b6a-b35f-b7817292334d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1299 microversion: 2.1 time: 0.178844 May 27 16:31:30.327648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 207/392] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:30 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:30.409746 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:30.410538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:30.420380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:30.420836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:30.421658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:30.422103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:30.591767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=18 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:31.039286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.039286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-be33a830-f4d9-4b6f-a351-259aa2347226 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.393230 May 27 16:31:31.039286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 186/393] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:30 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:31.042589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:31.042589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:31.042589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:31.042589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.042589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.044043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.044043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.105904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.105904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8b167ebb-cae2-4c4e-aacc-2ca66b278198 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.241468 May 27 16:31:31.105904 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 208/394] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:30 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:31.143369 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:31.144258 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:31.161395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.161854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.162660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.163104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.365288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:31.365288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:31.365288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.368638 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.370230 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.370839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.463532 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.501066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.502569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.511641 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7ae1c837-f980-4e15-bda2-e9061d9f2d0c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.371635 May 27 16:31:31.513675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 187/395] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:31 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:31.614525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:31.627207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4293f107-c7b8-4013-892b-f4d895d1039f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.285457 May 27 16:31:31.628151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 209/396] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:31 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:31.983696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:31.984342 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:31.993745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.994481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:31.995647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:31.995922 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.135440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:32.136082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:32.156769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.157548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.158353 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.158794 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.176567 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:32.189843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.199541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a249a20a-93e3-40ed-932b-4494285044ac tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.219755 May 27 16:31:32.200225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 188/397] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:31 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:32.393456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.405764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e7e489e3-14ce-4cae-8f13-2b3ea1b9e3d3 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.277477 May 27 16:31:32.407222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 210/398] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:32 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:32.532078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:32.532955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:32.540203 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.540648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.541478 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.541931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.650109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:32.651262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:32.660029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.660629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.661782 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:32.662533 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:32.845311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.860265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.861773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.863216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-12df73eb-aa4d-40bb-b155-66ed5759affd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.335418 May 27 16:31:32.866432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 189/399] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:32 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:32.944472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:32.952421 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-942aba45-ed37-4f5c-8c07-514e62f1f242 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.307604 May 27 16:31:32.962923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 211/400] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:32 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:33.217716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:33.218917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:33.227509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.228219 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.229163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.229765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.408956 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:33.420430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2e8ed146-bb25-4f38-9fb5-f96347b68e53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.206589 May 27 16:31:33.424927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:33.426525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:33.432573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 190/401] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:33 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:33.449100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.449100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.449100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.449100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.515671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-bca56231-2e56-46be-9fd4-f2b256bfee25 req-88c191ed-cbd9-4821-89fe-20d5d0177235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f4d9f6-9829-4b8d-96f2-982a04b2851f", "tag": "bfdd72e1-971a-4ccd-9405-99a3e2b528f6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:33.529384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bca56231-2e56-46be-9fd4-f2b256bfee25 req-88c191ed-cbd9-4821-89fe-20d5d0177235 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.530333 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bca56231-2e56-46be-9fd4-f2b256bfee25 req-88c191ed-cbd9-4821-89fe-20d5d0177235 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.563153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-bca56231-2e56-46be-9fd4-f2b256bfee25 req-88c191ed-cbd9-4821-89fe-20d5d0177235 service nova] Creating event network-changed:bfdd72e1-971a-4ccd-9405-99a3e2b528f6 for instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f on hv-cinder-84049 May 27 16:31:33.569130 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-bca56231-2e56-46be-9fd4-f2b256bfee25 req-88c191ed-cbd9-4821-89fe-20d5d0177235 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059567 May 27 16:31:33.570177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 191/402] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:31:33.661928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:33.685129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-12f6b5d8-3d8a-4f30-a95f-b1bf37020914 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.264037 May 27 16:31:33.689388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 212/403] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:33 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:33.886947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:33.887618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:33.894877 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.895319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.899872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:33.900648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:33.972884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:33.975035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:34.014042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.015826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.017102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.017456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.189253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.196772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.198895 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.200211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cee2b86d-176c-4932-8fc1-28bdd90516a8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.318081 May 27 16:31:34.201126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 192/404] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:33 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:34.227935 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.233982 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-dfdf5053-f058-4153-8e11-948231df33d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.267547 May 27 16:31:34.234779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 213/405] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:33 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:34.439918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:34.440686 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:34.447435 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.452897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.452897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.452897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.610264 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.621239 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-60425199-c988-4544-8e6e-2908181b4d90 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.186563 May 27 16:31:34.625216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 193/406] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:34 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:34.704155 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:34.705446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:34.712473 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.713001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.713868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:34.714509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:34.876737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:34.889299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f4df369c-500f-451b-85d2-75473321dc2a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.189554 May 27 16:31:34.897765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 214/407] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:34 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:35.219926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:35.219926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:35.228822 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.230733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.230733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.231080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.253011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:35.257379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:35.273397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.274197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.275106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.275564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.449367 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:35.459538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:35.461755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:35.463153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-51955d24-c0a1-413a-a17c-670919d07c24 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.248045 May 27 16:31:35.476045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 194/408] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:35 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:35.476555 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:35.485108 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-384f20b6-f52f-4a77-a847-68da0c145974 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.235959 May 27 16:31:35.492596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 215/409] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:35 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:35.639669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:35.647091 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:35.647790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.648249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.649037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.649511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.909701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:35.910293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:35.917262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.918133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:35.919084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:35.919540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:36.194250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.209629 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ba8b3f6d-5102-4503-9601-0007dac87af5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1723 microversion: 2.1 time: 0.573171 May 27 16:31:36.221224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 195/410] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:35 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:36.330113 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.339464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0960a599-f642-4268-9f78-306e81c4493c tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.435776 May 27 16:31:36.340083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 216/411] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:35 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:36.482538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:36.483241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:36.491367 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:36.491840 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:36.492871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:36.493297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:36.515037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:36.516017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:36.523826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:36.524868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:36.525794 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:36.526870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:36.759419 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.769245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.771008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.772537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:36.774176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-88e96984-bcd2-4ea9-b747-3a1f7eb9f614 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.295825 May 27 16:31:36.774745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 196/412] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:36 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:36.785804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0e42e998-3d5b-4c6b-830f-cce3fe446bba tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.273897 May 27 16:31:36.785804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 217/413] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:36 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:37.228299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:37.228991 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:37.247111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.247837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.248833 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.249495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.358456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:37.366384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:37.372375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.372909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.373816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.378063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.518933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:37.533562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c594534b-602f-4a93-a3d5-117ddf9015e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1700 microversion: 2.1 time: 0.308967 May 27 16:31:37.534751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 218/414] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:37 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1700 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:37.560003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-24138595-4cb0-48e4-a4b9-4e3fabba6279 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:37.585184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24138595-4cb0-48e4-a4b9-4e3fabba6279 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.585670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24138595-4cb0-48e4-a4b9-4e3fabba6279 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.676594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:37.691642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-535c47fd-6a54-4297-98d6-7b62aa73bbca tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.337187 May 27 16:31:37.692232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 197/415] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:37 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:37.793742 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-24138595-4cb0-48e4-a4b9-4e3fabba6279 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Going to try to start instance {{(pid=118488) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 16:31:37.794933 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:37.795559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:37.810376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.812823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.814293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:37.818902 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:37.878879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:38.078696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.089708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-092b2bfa-7faa-4e82-8349-162dd0456971 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.298573 May 27 16:31:38.090289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 198/416] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:37 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:38.114951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:38.122985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:38.134096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.134843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.135942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.136537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.371347 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-24138595-4cb0-48e4-a4b9-4e3fabba6279 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.770069 May 27 16:31:38.371347 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 219/417] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:31:37 2022] POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:31:38.372147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.372259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:38.372259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:38.372438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.372548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.372650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.372747 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.372844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b3206eec-c944-4e23-8af3-b448c435fdd7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.252459 May 27 16:31:38.372947 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.372947 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.373131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 199/418] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:38 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:38.533213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.543956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6a31cbda-704f-41e4-bcd6-41a872062453 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1709 microversion: 2.1 time: 0.218316 May 27 16:31:38.554234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 220/419] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:38 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1709 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:38.710195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:38.713682 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:38.721892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.722653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.724459 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:38.725083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:38.884917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:38.894317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bc2e91fc-8de2-4089-8e2a-514b176c1fbb tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.188707 May 27 16:31:38.895869 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 200/420] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:38 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:39.107266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:39.108519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:39.119050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.119503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.120404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.120855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.294404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:39.311129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eab02a6f-1a0a-4165-9a6e-c3f55c77a0a5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.207726 May 27 16:31:39.323022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 221/421] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:39 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:39.368736 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:39.369269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:39.376786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.377295 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.378104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.378541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.561064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:39.562785 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:39.572772 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.579893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.581487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.582120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.628681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:39.650471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:39.662217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:39.662217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-53058c84-44b1-4af5-8047-4ad2a94b350f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1751 microversion: 2.20 time: 0.289680 May 27 16:31:39.662217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 201/422] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:39 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1751 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:39.842950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:39.857962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a07786fd-1edd-4f8d-a528-c6f7d4c607f6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1709 microversion: 2.1 time: 0.300591 May 27 16:31:39.859204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 222/423] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:39 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1709 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:39.906308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-eaf5c47c-ceea-49b9-b99f-64c8c5db6b77 req-4ecfb428-910c-4b3f-bebb-a4c65ffc9237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd5e49e-af80-42b8-9706-6809abc10d9c", "name": "network-vif-plugged", "status": "completed", "tag": "047fee43-35eb-4d21-b702-885e4f5d2c79"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:39.913156 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:39.913907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:39.919996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-eaf5c47c-ceea-49b9-b99f-64c8c5db6b77 req-4ecfb428-910c-4b3f-bebb-a4c65ffc9237 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.920778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-eaf5c47c-ceea-49b9-b99f-64c8c5db6b77 req-4ecfb428-910c-4b3f-bebb-a4c65ffc9237 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.923306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.925119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.935151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:39.936025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:39.958073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-eaf5c47c-ceea-49b9-b99f-64c8c5db6b77 req-4ecfb428-910c-4b3f-bebb-a4c65ffc9237 service nova] Creating event network-vif-plugged:047fee43-35eb-4d21-b702-885e4f5d2c79 for instance bcd5e49e-af80-42b8-9706-6809abc10d9c on hv-cinder-84049 May 27 16:31:39.967073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-eaf5c47c-ceea-49b9-b99f-64c8c5db6b77 req-4ecfb428-910c-4b3f-bebb-a4c65ffc9237 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064430 May 27 16:31:39.968338 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 202/424] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:40.185444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:40.193320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-df2cb750-b55b-4d69-874c-219f2474b454 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.283849 May 27 16:31:40.218069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 223/425] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:39 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:40.383968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:40.383968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:40.383968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.383968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.384443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.384443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.540080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:40.545953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-53d66b94-53f0-4b60-a407-de067a497581 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.203856 May 27 16:31:40.546813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 203/426] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:40 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:40.674699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:40.675356 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:40.682948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.683445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.684267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.684777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.872967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:40.877462 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:40.878744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:40.889951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:40.891914 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.892394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.893126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:40.893371 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:40.894063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:40.895351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1cd1c1da-6b34-4a54-a0e3-51e07e873b4a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.225057 May 27 16:31:40.897563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 224/427] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:40 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:41.113828 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:41.124018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b3d4386d-5f7a-43a8-9742-a5ac979e8ed1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1709 microversion: 2.1 time: 0.251314 May 27 16:31:41.124602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 204/428] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:40 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1709 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:41.224249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:41.226022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:41.238598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.239493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.240817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.241683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.452714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:41.462671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-91a71c16-fc45-473c-9b1f-4ecacb192412 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.242271 May 27 16:31:41.463613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 225/429] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:41 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:41.562799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:41.563629 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:41.570781 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.571374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.572238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.572900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.715387 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:41.729862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dd37746c-9b07-4ee3-aa0e-3e5559dd018c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.170771 May 27 16:31:41.730625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 205/430] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:41 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:41.915341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:41.915884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:41.922008 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.926298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.926298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:41.926298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:41.929697 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:42.076354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:42.084986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:42.086594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:42.087775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f4544fa8-0c42-4c76-a7ea-6b7134c4c696 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.176535 May 27 16:31:42.088332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 226/431] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:41 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:42.142499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:42.143356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:42.151161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.151816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:42.152574 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.152852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:42.308962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:42.317806 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6fc19b1d-9e6c-4799-ac37-4d9754f866de tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1709 microversion: 2.1 time: 0.179339 May 27 16:31:42.329933 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 206/432] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:42 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:42.339697 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-362ff75a-89f1-4d0f-b21d-1cb271b85bfa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'create', calling method: .version_select at 0x7f0e99fb4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1566390221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUI6V99HxxIYDYWHk5z2QgA92XUC4vv1kW66W4i+NkFkrAeu0q848xNMeE0u8mOUMSAlixVKVszHARARe5RI3fpE8+Cu9Jv9D3CajF+EVvKBjE1uaC1vSH4BOvXcD3YnQ=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:42.355674 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-362ff75a-89f1-4d0f-b21d-1cb271b85bfa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Getting quotas for project bf8f192a31204d97b3b2e8895856a459. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:31:42.359740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-362ff75a-89f1-4d0f-b21d-1cb271b85bfa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Getting quotas for user 650592005e10426b95a76ebd97b07455 and project bf8f192a31204d97b3b2e8895856a459. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:31:42.486660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:42.487790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:42.500336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.501356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:42.502895 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.503794 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:42.542644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-362ff75a-89f1-4d0f-b21d-1cb271b85bfa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.206447 May 27 16:31:42.553994 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 227/433] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:31:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:42.602895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1822473505", "imageRef": "f51e8d8f-8397-4732-bf1f-732ff5fb4ff3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1566390221", "networks": [{"uuid": "3457ce5e-af48-4869-9e42-c672efe05b5b"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:42.657130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] validate_networks() for [('3457ce5e-af48-4869-9e42-c672efe05b5b', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:31:42.763184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:42.771405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-565a9f88-257d-430d-b003-5e9c7583eeb9 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.292317 May 27 16:31:42.772386 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 207/434] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:42 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:42.777620 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:42.778221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:42.784238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.784678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:42.785531 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:42.785958 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.022354 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.033308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-17187d38-63c6-4c51-b7e4-484146773d9f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.259573 May 27 16:31:43.034511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 208/435] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:42 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:43.106032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:43.106801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:43.113458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.114118 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.115047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.115643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.151540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:31:43.152453 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:31:43.153022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:31:43.153680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:31:43.154157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:31:43.164266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.164801 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.165700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.166355 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.183600 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Getting quotas for project bf8f192a31204d97b3b2e8895856a459. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:31:43.188173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Getting quotas for user 650592005e10426b95a76ebd97b07455 and project bf8f192a31204d97b3b2e8895856a459. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:31:43.200012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:31:43.202497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f51e8d8f-8397-4732-bf1f-732ff5fb4ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:31:43.253691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.262639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.264167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.265488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-467e83ef-6092-49a9-9184-2959eceb2c6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.163803 May 27 16:31:43.266129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 209/436] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:43 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:43.335541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:43.336145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:43.346328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.346771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.347518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2a958cd4-dd01-4f1f-825a-af1ed0e72330 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749438 May 27 16:31:43.347733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.348173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.348537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 228/437] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:31:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 16:31:43.362182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bc870265-05de-46be-9e83-0492e0b5b0c3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:43.372343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bc870265-05de-46be-9e83-0492e0b5b0c3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:43.469440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bc870265-05de-46be-9e83-0492e0b5b0c3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.479753 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bc870265-05de-46be-9e83-0492e0b5b0c3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1259 microversion: 2.1 time: 0.121236 May 27 16:31:43.481675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 229/438] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:43 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:43.565922 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.576760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b09b0666-37c1-4f1b-94a6-05e39442d6a6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1713 microversion: 2.1 time: 0.245602 May 27 16:31:43.583550 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 210/439] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:43 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1713 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:43.789015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:43.789660 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:43.797100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.797597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.798790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.799406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.828320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-dbacc363-e14d-4e17-9ddf-200b4e14d9a3 req-38bff863-17c5-407d-a84f-0e421573d5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4d9f6-9829-4b8d-96f2-982a04b2851f", "name": "network-vif-plugged", "status": "completed", "tag": "bfdd72e1-971a-4ccd-9405-99a3e2b528f6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:43.838263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-dbacc363-e14d-4e17-9ddf-200b4e14d9a3 req-38bff863-17c5-407d-a84f-0e421573d5dc service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:43.838775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-dbacc363-e14d-4e17-9ddf-200b4e14d9a3 req-38bff863-17c5-407d-a84f-0e421573d5dc service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:43.851362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-dbacc363-e14d-4e17-9ddf-200b4e14d9a3 req-38bff863-17c5-407d-a84f-0e421573d5dc service nova] Creating event network-vif-plugged:bfdd72e1-971a-4ccd-9405-99a3e2b528f6 for instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f on hv-cinder-84049 May 27 16:31:43.856432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-dbacc363-e14d-4e17-9ddf-200b4e14d9a3 req-38bff863-17c5-407d-a84f-0e421573d5dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033573 May 27 16:31:43.857549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 211/440] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:31:43.943417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:43.960033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bb4a9724-edb1-4b81-9df8-097d40e2be64 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1314 microversion: 2.1 time: 0.175629 May 27 16:31:43.960619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 230/441] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:43 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:44.054129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:44.054838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:44.062478 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.062923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:44.064286 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.064774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:44.248788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:44.261397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-184e7872-0399-4cad-a68c-eb685be3bfaf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.213724 May 27 16:31:44.266634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 212/442] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:44 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:44.289401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:44.291602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:44.299428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.300057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:44.311625 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.312344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:44.498358 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:44.500329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9e4550c3-3766-4b4a-846f-e62ab10bbded tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:44.510801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9e4550c3-3766-4b4a-846f-e62ab10bbded tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:44.511337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:44.512688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:44.514508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d2a9694d-f320-42da-9d1f-a9420b324f37 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.233937 May 27 16:31:44.515580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 231/443] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:44 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:44.559735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9e4550c3-3766-4b4a-846f-e62ab10bbded tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:44.566650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9e4550c3-3766-4b4a-846f-e62ab10bbded tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1259 microversion: 2.1 time: 0.070813 May 27 16:31:44.567252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 213/444] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:44 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:44.979126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:44.988697 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:44.992071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.993173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:44.994033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:44.994559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.163699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.171855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-92fb2612-4904-43be-9c3f-feb8289fe594 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1499 microversion: 2.1 time: 0.199379 May 27 16:31:45.172778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 232/445] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:44 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1499 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:45.283652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:45.285080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:45.297998 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.299454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.301117 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.307118 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.549557 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:45.554172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:45.557324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.568521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1cf8805d-1d14-4a98-b52e-3cebdad4e317 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.288650 May 27 16:31:45.578277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 214/446] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:45 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:45.586659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:45.591469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:45.594774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.595317 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.600003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.602193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.605919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.606822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.607057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:45.610765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:45.759707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.773528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8efeebc1-3464-4062-abf6-4a48ccb912aa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.193073 May 27 16:31:45.774447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 215/447] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:45 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:45.874395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.888775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.894343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:45.895995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-77c948f1-3e71-4046-a08c-8d439af136a6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.365062 May 27 16:31:45.901732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 233/448] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:45 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:46.444578 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:46.445957 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:46.455254 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.456154 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.457418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.458090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.494246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:31:46.564329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:46.594685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:46.595300 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:46.605075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.605556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.610612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.611986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.824880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:46.920996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:46.929640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e3252945-a0be-4166-804f-f46222e58d6a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.339206 May 27 16:31:46.930228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 234/449] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:46 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:46.943996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:46.944650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:46.951439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.951925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.952868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.953530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.968399 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0bf4274b-d411-4b19-9674-275e87d4155b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 204 len: 0 microversion: 2.1 time: 0.529723 May 27 16:31:46.969413 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 216/450] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:31:46 2022] DELETE /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:31:46.975839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:46.976652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:46.983547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.989045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:46.990706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:46.991352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:47.039344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:47.052258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7942c3e4-e16b-48e6-aee3-14ec941bb3ed tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.112274 May 27 16:31:47.063869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 235/451] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:46 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:47.063869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:47.065387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:47.072792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:47.073431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:47.074387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:47.074895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:47.361320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:47.380018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:47.382451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:47.383941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d71777be-ef80-4317-8f79-cae0cee6adeb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.413381 May 27 16:31:47.396043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 217/452] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:46 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:47.404154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:47.431223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a11537f9-1d0d-440c-838a-fc0a0de86ed4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.371504 May 27 16:31:47.434630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 236/453] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:47 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:47.948439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:47.958181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:47.967227 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:47.968958 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:47.970061 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:47.970725 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.079100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:48.080887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:48.096549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.097584 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.098419 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.099024 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.185247 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.188149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.196300 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7872ce95-e6e7-42a3-8050-8deca4b6e654 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.126988 May 27 16:31:48.196893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 237/454] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:48 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:48.209977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3423d14a-1fc9-4ad5-a691-d8cece6b0730 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.267091 May 27 16:31:48.210521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 218/455] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:47 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:48.401944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:48.403114 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:48.409935 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.410749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.411893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.412702 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.449209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:48.449967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:48.456407 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.456857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.457663 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:48.458097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:48.647756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.660354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.661981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.664617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0fd74bfc-189e-4c99-b063-2e6c3db538c9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.265496 May 27 16:31:48.665719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 238/456] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:48 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:48.675910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:48.687068 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3ae2d0ed-b241-4e30-a9f9-a630ed853afa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.241477 May 27 16:31:48.688757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 219/457] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:48 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:49.215764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:49.216371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:49.224055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.225111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.226061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.226525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.228730 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:49.230155 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:49.238300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.249518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.249518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.249518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.310305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:49.318734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fe38c2c4-0856-4537-8c67-1bbd321251c1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.106139 May 27 16:31:49.319714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 239/458] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:49 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:49.412947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:49.421034 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f0261390-8129-4e4e-bc4b-60eef0310094 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.197047 May 27 16:31:49.421712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 220/459] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:49 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:49.686851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:49.687885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:49.696703 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.697459 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.698250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.698916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.706566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:49.707173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:49.718658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.721967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:49.727428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:49.727428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:50.298595 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.310437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.313599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.318802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.320708 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a6bab288-c5c6-4cdf-86e5-fcb3be3d36e0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.634613 May 27 16:31:50.322079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 240/460] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:49 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:50.335640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f5de0e28-a200-46b7-9034-334370380ef2 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.633410 May 27 16:31:50.339693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:50.346439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:50.350737 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 221/461] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:49 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:50.358512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:50.360282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:50.360282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:50.360282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:50.440402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:50.441577 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:50.456907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:50.458000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:50.459604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:50.460627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:50.535281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.546387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d58ac760-bb1a-4aca-b5d9-61465d13929f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.213951 May 27 16:31:50.550493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 241/462] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:50 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:50.676017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:50.689037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ef2cda4b-9493-49a6-86f5-72fcfafe1684 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.253189 May 27 16:31:50.690592 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 222/463] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:50 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:51.340734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:51.344842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:51.348223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.349097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.350487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.351141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.354329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:51.354940 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:51.362384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.362964 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.363944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.364422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.766001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:51.775306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:51.789273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:51.789273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:51.789273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7c992c37-2d29-4d73-98dd-066f2f3f8e4e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.444509 May 27 16:31:51.789809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 242/464] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:51 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:51.789908 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b3b99cef-7ebb-4813-86ec-183f963ba123 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.433161 May 27 16:31:51.790013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:51.790013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:51.793990 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 223/465] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:51 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:51.808476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.810028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.812549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.816143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.817956 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:51.818607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:51.846530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.847352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.848441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:51.851074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:51.977593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:51.994126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fa47a223-d1e8-4eb2-8434-fc4570e0e7b5 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.206842 May 27 16:31:51.994868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 243/466] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:51 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:52.153283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:52.162061 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9ca2e8f6-c909-4efd-8010-0084685b523c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.366772 May 27 16:31:52.171422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 224/467] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:51 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:52.803904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:52.804835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:52.805443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:52.806540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:52.814297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:52.814532 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:52.815122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:52.815979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:52.816346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:52.816874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:52.817457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:52.818086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:52.818902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:53.174493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:53.208165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.222611 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.222765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.223287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.225816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c6ee63f1-cd26-4a51-ae7c-5d496a920365 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.427524 May 27 16:31:53.228524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 225/468] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:52 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:53.232456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:53.233596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:53.234680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5de2d824-b234-42d2-8596-b7f0cb6a437f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.436474 May 27 16:31:53.245693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 244/469] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:52 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:53.245693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:53.245693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:53.249729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:53.250370 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:53.251303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:53.251893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:53.254265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:53.257165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:53.257165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:53.257165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:53.268718 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:53.351665 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.360520 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4331d97e-6480-4b0e-bfab-8c05ddf0d535 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1263 microversion: 2.1 time: 0.132766 May 27 16:31:53.367273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 226/470] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:53 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1263 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:53.435402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:53.444915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3bf69163-7682-4b7f-a1f9-fa2ff93bdd8c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.207484 May 27 16:31:53.446017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 245/471] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:53 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:54.246931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:54.247927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:54.253676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:54.255494 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:54.255597 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.255966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.256883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.257309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.258891 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=12 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:54.263987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.264581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.265550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.266217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.508027 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.520657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.522818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.524023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-22b82d1f-ccef-40b4-bebe-3edaee32ddc5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.282459 May 27 16:31:54.532694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.541195 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8f0c6dc4-71ee-4114-b706-d217272ad6d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.291818 May 27 16:31:54.541806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 246/473] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:54 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:54.541998 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 227/473] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:54 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:31:54.547010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:54.552911 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:54.553960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:54.558045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:54.565782 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:54.569971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.575005 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.575005 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.575221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.575221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.575221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:54.575221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.575781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:54.667504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.681850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4ea558d3-3ab7-454f-9a90-adfee86e61f3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1255 microversion: 2.1 time: 0.138290 May 27 16:31:54.693467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 228/474] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:54 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1255 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:54.771132 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:54.778831 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-280c4b52-7558-40bb-b8ec-b27994e41d4b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1366 microversion: 2.1 time: 0.229614 May 27 16:31:54.779798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 247/475] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:54 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:55.543391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:55.544015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:55.551992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.552457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.554066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.554515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.567867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:55.569723 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:55.586078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.586984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.588003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.590059 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.838969 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:55.868675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:55.871242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:55.872726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4903ea53-3326-4a38-a7b0-672bd397a520 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.333649 May 27 16:31:55.873593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 229/476] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:55 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:55.879258 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:55.880080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:55.888744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.889444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.890423 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.891040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.948854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:55.957996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25ad7688-25a1-4bbd-9878-03facefb8a89 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.394223 May 27 16:31:55.960337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 248/477] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:55 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:55.982572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:55.983299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:55.990815 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.991892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.993233 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:55.994464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:55.997653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:56.009745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-807d23f2-8c44-4f03-9530-1e7741012162 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1255 microversion: 2.1 time: 0.134872 May 27 16:31:56.010344 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 230/478] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:55 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1255 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:56.154517 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:56.163106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-42bbae83-2814-48a9-8667-88d9b2b3d096 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1554 microversion: 2.1 time: 0.201372 May 27 16:31:56.163880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 249/479] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:55 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:56.188779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:56.189274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:56.195621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.196082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:56.196894 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.197334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:56.286412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3b8ed1bd-0784-4a7b-bcd6-06a7ab4bb77a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101625 May 27 16:31:56.287641 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 231/480] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:31:56 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:56.905564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:56.906823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:56.916025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.916778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:56.918487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.919142 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:56.982728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:56.983370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:56.989647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.991102 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:56.992079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:56.992687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:57.205210 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:57.221360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:57.223621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:57.226456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7f51b5b1-8a26-4612-a768-3e5c45645e11 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.325707 May 27 16:31:57.240658 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 250/481] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:56 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:57.249035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:57.250580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:57.258204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:57.259273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:57.260620 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:57.261890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:57.311216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:57.317275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:57.328714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d2a0300b-e73e-42f6-a9db-7dd0b549425b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1505 microversion: 2.1 time: 0.350116 May 27 16:31:57.330114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 232/482] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:56 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:57.398293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:57.416297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b50d1a2d-12b7-4bde-9d6e-84becc201e3c tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1311 microversion: 2.1 time: 0.173638 May 27 16:31:57.419751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 251/483] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:57 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:58.101178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-2174aaae-f5bd-42d9-8c54-f01fe54ddcfb req-14473abb-f108-4af5-b03b-0c6d91ad6047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd5e49e-af80-42b8-9706-6809abc10d9c", "name": "network-vif-deleted", "tag": "047fee43-35eb-4d21-b702-885e4f5d2c79"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:31:58.137927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-2174aaae-f5bd-42d9-8c54-f01fe54ddcfb req-14473abb-f108-4af5-b03b-0c6d91ad6047 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.139723 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-2174aaae-f5bd-42d9-8c54-f01fe54ddcfb req-14473abb-f108-4af5-b03b-0c6d91ad6047 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.180131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-2174aaae-f5bd-42d9-8c54-f01fe54ddcfb req-14473abb-f108-4af5-b03b-0c6d91ad6047 service nova] Creating event network-vif-deleted:047fee43-35eb-4d21-b702-885e4f5d2c79 for instance bcd5e49e-af80-42b8-9706-6809abc10d9c on hv-cinder-84049 May 27 16:31:58.186101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-2174aaae-f5bd-42d9-8c54-f01fe54ddcfb req-14473abb-f108-4af5-b03b-0c6d91ad6047 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095855 May 27 16:31:58.187081 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 233/484] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:31:58.250075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:58.250684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:58.262613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.263420 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.264383 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.265446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.355075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:58.359734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:58.391557 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.392019 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.392802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.394543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.562109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:58.571646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-595da52e-daef-43cb-820e-b536ee8f32c7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1299 microversion: 2.1 time: 0.228322 May 27 16:31:58.572237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 234/485] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:58 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:31:58.579118 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:58.589231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:58.590506 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:58.593926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:58.599361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:58.608692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-faf5354e-32c0-44e1-831e-1fc0188c4e1a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.361336 May 27 16:31:58.612485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 252/486] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:58 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:31:58.626714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.627575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.629037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:58.631396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:58.839874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:31:58.861584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d8709141-d2ad-4a93-9126-fa0860bcea82 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1329 microversion: 2.1 time: 0.283634 May 27 16:31:58.883586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 235/487] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:58 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1329 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:31:59.590242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:59.591573 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:59.610010 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:59.613440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:59.614259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:59.614821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:59.653720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:31:59.655248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:31:59.687340 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:59.688287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:59.693171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:59.695733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:59.763197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:31:59.769578 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:31:59.770170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lazy-loading 'fault' on Instance uuid bcd5e49e-af80-42b8-9706-6809abc10d9c {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:00.169834 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:00.180516 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8731738c-4a3d-4dad-a4bd-594d24261423 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 200 len: 1304 microversion: 2.1 time: 0.596273 May 27 16:32:00.189677 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 253/488] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:31:59 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 1304 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:00.227418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:00.231624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:00.271145 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:00.272197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:00.277703 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:00.282816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:00.699277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:00.722762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:00.724644 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:00.733423 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a19b30cd-c94e-49a6-9978-b957cf648307 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 1.098145 May 27 16:32:00.734287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 236/489] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:31:59 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:00.749417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-099167b4-ee1f-4efd-86f9-398d677b9335 req-1f635a49-813a-4c02-bca8-a37bf7688bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f4d9f6-9829-4b8d-96f2-982a04b2851f", "tag": "bfdd72e1-971a-4ccd-9405-99a3e2b528f6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:00.767141 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-099167b4-ee1f-4efd-86f9-398d677b9335 req-1f635a49-813a-4c02-bca8-a37bf7688bb4 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:00.777998 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-099167b4-ee1f-4efd-86f9-398d677b9335 req-1f635a49-813a-4c02-bca8-a37bf7688bb4 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:00.805357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-099167b4-ee1f-4efd-86f9-398d677b9335 req-1f635a49-813a-4c02-bca8-a37bf7688bb4 service nova] Creating event network-changed:bfdd72e1-971a-4ccd-9405-99a3e2b528f6 for instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f on hv-cinder-84049 May 27 16:32:00.826519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-099167b4-ee1f-4efd-86f9-398d677b9335 req-1f635a49-813a-4c02-bca8-a37bf7688bb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088084 May 27 16:32:00.829293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 237/490] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:00.955579 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:00.965856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7233a14b-a157-4257-8ff0-20e22f77c52b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.774663 May 27 16:32:00.973232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 254/491] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:00 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:01.207169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:01.207909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: bcd5e49e-af80-42b8-9706-6809abc10d9c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:01.220042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:01.231418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:01.232575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:01.233104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:01.297128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] HTTP exception thrown: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Request method failure captured: May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c HTTP/1.1 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPzLLdPMA95hSVG-blfLzM9kposITdImxZW01ffi3_tVBtNi3QVaB1RysbSD0AtiStm0ckqlrKmETDghf25jGawciZD_5euLzKoEaROMRL7BXsH0NPwIrdxilbQSot2l_l3rx4qSlf9ofo69EDC4vY3WnWZWU2fWL70ud5sP_nvG-wg May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: e1194991899d4dd5ac974608165516b8 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesActionsTest-904608882 May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:32:01.356040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1194991899d4dd5ac974608165516b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1194991899d4dd5ac974608165516b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1194991899d4dd5ac974608165516b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1194991899d4dd5ac974608165516b8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesActionsTest-904608882 May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: e1194991899d4dd5ac974608165516b8 May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesActionsTest-904608882 May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesActionsTest-904608882-project May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 97c3e6bd775848f39176015d42749fa2 May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesActionsTest-904608882-project May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. May 27 16:32:01.357536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'bcd5e49e-af80-42b8-9706-6809abc10d9c'} May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:32:01.358842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. May 27 16:32:01.361224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:01.363590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Returning 404 to user: Instance bcd5e49e-af80-42b8-9706-6809abc10d9c could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:32:01.363590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1b9e8da1-7b33-4437-819a-7c8239e11e67 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c" status: 404 len: 111 microversion: 2.1 time: 0.107907 May 27 16:32:01.363590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 238/492] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:01 2022] GET /compute/v2.1/servers/bcd5e49e-af80-42b8-9706-6809abc10d9c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:32:01.502259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1401272371", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "networks": [{"uuid": "4600418a-b3f7-4bdf-b9ec-b57285402638"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:01.602745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] validate_networks() for [('4600418a-b3f7-4bdf-b9ec-b57285402638', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:32:01.755999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:01.757289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:01.779721 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:01.790838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:01.791699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:01.792144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:02.462804 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:02.493913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:02.495577 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:02.496936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-21184325-b414-4ade-abfd-a94031b44fb0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.744823 May 27 16:32:02.519682 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 239/493] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:01 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:02.527903 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:02.534374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:02.542371 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:02.543400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:02.544442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:02.545032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.184080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:03.197500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a944c1ef-4ea9-4c2b-bd14-19118eb57139 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.673431 May 27 16:32:03.198385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 240/494] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:02 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:03.227378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:32:03.227975 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:32:03.228281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:32:03.230539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:32:03.230971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:32:03.246626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:03.250060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.250897 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:03.251346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.318251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Getting quotas for project e1194991899d4dd5ac974608165516b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:32:03.323538 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Getting quotas for user 97c3e6bd775848f39176015d42749fa2 and project e1194991899d4dd5ac974608165516b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:32:03.339080 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:32:03.343867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:32:03.543536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:03.558690 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:03.569617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:03.570069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.570853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:03.579395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-29cc6559-f668-4b24-a9dd-6a6bbd7e01e0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.084455 May 27 16:32:03.580047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 255/495] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:32:03.580501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.597802 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-585874ca-080d-4a93-a166-6742d3b413d6 req-c1213e80-a03d-42f8-a5aa-dcba50c1fa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:03.642227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-585874ca-080d-4a93-a166-6742d3b413d6 req-c1213e80-a03d-42f8-a5aa-dcba50c1fa20 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:03.642227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-585874ca-080d-4a93-a166-6742d3b413d6 req-c1213e80-a03d-42f8-a5aa-dcba50c1fa20 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:03.676328 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-585874ca-080d-4a93-a166-6742d3b413d6 req-c1213e80-a03d-42f8-a5aa-dcba50c1fa20 service nova] Creating event network-changed:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:32:03.696318 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-585874ca-080d-4a93-a166-6742d3b413d6 req-c1213e80-a03d-42f8-a5aa-dcba50c1fa20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094674 May 27 16:32:03.709817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 256/496] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:03.715841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4254ab18-ca91-4039-b2c8-26ab61360dfa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:03.716531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4254ab18-ca91-4039-b2c8-26ab61360dfa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:03.842034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4254ab18-ca91-4039-b2c8-26ab61360dfa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:03.852837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4254ab18-ca91-4039-b2c8-26ab61360dfa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1214 microversion: 2.1 time: 0.141612 May 27 16:32:03.862630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 257/497] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:03 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:04.027631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:04.039201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:04.042169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:04.043762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2bd756ab-cfdc-4bf4-a2d5-12c4973c2a2e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.509010 May 27 16:32:04.044827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 241/498] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:03 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:04.215636 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:04.216637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:04.233113 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:04.234742 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:04.235775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:04.236432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:04.520351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:04.540295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d19ee167-0518-4bdf-8049-991d8c163ec4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.328631 May 27 16:32:04.545301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 258/499] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:04 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:04.871980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-abfee07e-9b5c-4493-916e-8f056e15d7d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:04.873279 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-abfee07e-9b5c-4493-916e-8f056e15d7d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:04.971055 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-abfee07e-9b5c-4493-916e-8f056e15d7d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:04.978985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-abfee07e-9b5c-4493-916e-8f056e15d7d4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1214 microversion: 2.1 time: 0.111768 May 27 16:32:04.980023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 242/500] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:04 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:05.080124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:05.081545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:05.108316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:05.108316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:05.108316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:05.108316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:05.294929 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:05.303749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:05.305251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:05.306439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c3960abf-dced-42aa-91ee-12a93591149b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.245728 May 27 16:32:05.307004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 259/501] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:05 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:05.563110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:05.563734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:05.571601 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:05.572040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:05.573167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:05.574116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:05.726429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:05.739645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-382ec53c-ab3d-4013-b0a0-b378f382bc7f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.181168 May 27 16:32:05.746635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 243/502] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:05 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:05.997888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:05.998512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:06.005069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.005560 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.006431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.007209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.078552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:06.087331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-daf92b6b-3db6-49ab-91fa-051d25c3e39b tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.093801 May 27 16:32:06.087918 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 260/503] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:05 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:06.332030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:06.336402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:06.345498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.346662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.349678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.350443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.517570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:06.533402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:06.534315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:06.535503 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-53eae8d0-f7d8-4361-9803-ca087ab7ebc9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.208875 May 27 16:32:06.536070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 244/504] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:06 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:06.759199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:06.759802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:06.766140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.766847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.767601 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:06.768207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:06.893006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e71fa8d8-a8b1-4b46-9e0c-1d2e5b5daa9a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Action: 'create', calling method: .version_select at 0x7f0e99fb4550>, body: {"keypair": {"name": "tempest-TestShelveInstance-310070568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJ+yZaSpzLJ0NfBExri5HazvRc+ELhAx0aBU9BKshvwBUMuJbtr9I+peV8Ch0OJg4JMpJNIBbEqzPZva4c+gyGu5GfmafCNcF5X9oOLqoUnu/ALoywtjvfGbhPDorV3w=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:06.908418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-e71fa8d8-a8b1-4b46-9e0c-1d2e5b5daa9a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Getting quotas for project e57270a9020844e9baf044630fb81bcd. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:32:06.912242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-e71fa8d8-a8b1-4b46-9e0c-1d2e5b5daa9a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Getting quotas for user 672b81726d1445518823f6e7c8887978 and project e57270a9020844e9baf044630fb81bcd. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:32:07.022671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:07.030491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-255cc810-748f-4990-b978-afe68bde5dbc tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.275059 May 27 16:32:07.034247 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 245/505] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:06 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:07.066855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e71fa8d8-a8b1-4b46-9e0c-1d2e5b5daa9a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.359893 May 27 16:32:07.067545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 261/506] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:32:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:07.104874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:07.105557 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:07.111869 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:07.112339 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:07.113049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:07.113523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:07.197657 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:07.206345 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-de7c956f-c48c-47e5-883a-54198e13ee97 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.105663 May 27 16:32:07.208245 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 246/507] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:07 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:07.554098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:07.554798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:07.561119 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:07.564337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:07.564337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:07.564337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:07.719572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:07.729608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:07.731329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:07.732718 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f91ddaed-51e8-4d15-bf2f-5f75baf5396a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.182568 May 27 16:32:07.733268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 262/508] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:07 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:08.048446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:08.049055 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:08.056237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.059312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.059312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.059312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.216920 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:08.225264 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9024604f-f8e1-4fd2-beeb-af57aacecddb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.180625 May 27 16:32:08.225638 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:08.226307 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 247/509] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:08 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:08.226553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:08.233784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.238710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.239952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.240379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.321560 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:08.329542 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6e2f2667-2b85-4570-adca-4fd53d3ff94d tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.108512 May 27 16:32:08.330304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 263/510] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:08 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:08.752923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:08.753568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:08.760999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.761477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.762250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:08.762676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:08.941893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:08.954844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:08.956709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:08.957999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c2ff4620-0ac2-4aee-84bb-edbc261ba8ce tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.209511 May 27 16:32:08.958625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 248/511] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:08 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:09.064848 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ab5ca23-a972-4eee-95d1-7b16c982c31f"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:09.065950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:09.072084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.072527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.073287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.073789 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.253092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:09.254698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:09.269420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.270315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.271658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.273556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.440143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:09.447962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2b03efca-8df0-467d-98b8-c138d15a5e73 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.206637 May 27 16:32:09.448666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 249/512] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:09 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:09.453507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:09.453960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:09.460667 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.461207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.462198 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.462760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:09.524932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:09.534236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-211036e2-86b6-4e77-a030-42626b0ae8b7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.084516 May 27 16:32:09.535364 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 250/513] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:09 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:09.978500 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:09.980241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:09.998720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:09.999734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.001761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:10.006240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.287870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:10.303389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:10.310099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:10.311327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-44328ddf-571b-4579-926c-24077799af4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.338635 May 27 16:32:10.311927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 251/514] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:09 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:10.466849 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:10.467581 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:10.474797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:10.475416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.476525 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:10.477741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.502525 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:10.705749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:10.714173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-586f4a79-3ac2-4b43-be79-b975e3983ffa tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.252290 May 27 16:32:10.718396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 252/515] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:10 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:10.720885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:10.721311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:10.729379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:10.730121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.731178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:10.731498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:10.875180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:10.890253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-063f0516-396d-47fc-a71a-ab838bfe990a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.169148 May 27 16:32:10.891263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 253/516] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:10 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:11.333315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:11.334787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:11.344150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.345293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:11.346160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.346708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:11.505389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:11.517424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:11.521153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:11.522787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-74bc8797-8782-4519-a59f-ae77160b0a3b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.194453 May 27 16:32:11.523543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 254/517] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:11 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:11.731903 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:11.732702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:11.740159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.740752 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:11.742266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.744449 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:11.918924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:11.926941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cc104986-73e1-4352-b2f8-a5eb2ae47729 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.199150 May 27 16:32:11.927891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 255/518] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:11 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:11.933043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:11.933679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:11.943021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.943473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:11.944270 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:11.945255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:12.017704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:12.026346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fb628f7b-c596-472c-9479-94493126b7aa tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.096905 May 27 16:32:12.027033 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 256/519] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:11 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:12.542989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:12.543604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:12.550864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:12.551684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:12.552771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:12.553216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:12.716706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:12.725319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:12.727801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:12.736505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dbc525bc-38c7-4455-8448-3dad7f1bf4a7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.198233 May 27 16:32:12.737813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 257/520] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:12 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:12.946180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:12.946811 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:12.953756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:12.954208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:12.955096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:12.955560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:13.133692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:13.153702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3d302cff-912b-4b65-9bb9-4a06a4846a4a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.212781 May 27 16:32:13.154569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 258/521] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:12 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:13.163930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:13.165235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:13.172414 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:13.172931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:13.173766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:13.174208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:13.250662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:13.276360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-86084e43-1924-4ef3-8fe3-b40cc8c22a6f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.116693 May 27 16:32:13.277584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 259/522] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:13 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:13.286803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:13.759019 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:13.759850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:13.770528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:13.776452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:13.776452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:13.776452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:13.980216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:13.992362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:13.994060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:13.995523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a845256f-8be6-452e-a6dc-ad180420e0f3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.242794 May 27 16:32:13.999364 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 260/523] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:13 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:14.177616 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:14.178427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:14.196049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:14.196553 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:14.197470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:14.198270 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:14.392702 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:14.401934 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-63252370-178e-4cde-b19e-02c7d4a420bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.228792 May 27 16:32:14.404504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 261/524] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:14 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:14.407472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:14.408010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:14.415376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:14.415827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:14.416615 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:14.417048 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:14.504695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:14.515639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5ce5ddc8-669c-4491-b122-76cfa1cad731 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.111927 May 27 16:32:14.516470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 262/525] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:14 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:15.018161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:15.018861 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:15.022463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:15.028193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.028711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.029499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.029925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.183303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:15.192122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:15.195493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:15.195802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b57e16a8-594b-4426-b889-4d702b35e6a1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.181073 May 27 16:32:15.196506 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 263/526] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:15 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:15.422433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:15.433047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:15.433047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:15.433047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.433047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.433481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.433481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.574916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:15.586127 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fb2e2f32-bafe-4731-8b27-65670ec1baea tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.166771 May 27 16:32:15.589084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 264/527] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:15 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:15.597224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:15.598002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:15.604484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.604925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.605798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:15.606237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:15.688970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:15.701981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bbc66637-00f0-41b1-85ed-de1ad964a658 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.109069 May 27 16:32:15.702883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 265/528] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:15 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:16.215889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:16.216862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:16.223641 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.224094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.224859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.225291 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.370009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:16.378968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:16.380443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:16.381633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fb507d76-1f41-49ac-94fa-e717bf6bd6fa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.170491 May 27 16:32:16.382214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 266/529] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:16 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:16.605690 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:16.606398 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:16.612590 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.614609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.614609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.614609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.759858 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:16.767194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1f459c60-497c-49f6-85f0-a50a1ffccd2e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.166331 May 27 16:32:16.767760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 267/530] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:16 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:16.772135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:16.772728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:16.779241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.784246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.784246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:16.784246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:16.844043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:16.853416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-309dd34b-cd4c-43ea-832c-bb3b7ffd5e83 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1218 microversion: 2.1 time: 0.084545 May 27 16:32:16.854208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 268/531] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:16 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:16.918875 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=12 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:17.402502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:17.403190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:17.439624 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:17.440700 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:17.452864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:17.454441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:17.460847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:17.463627 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:17.673725 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:17.683555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:17.685125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:17.686360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-adfc4870-f5e9-4c59-9c3c-12d5ce9cb72b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.290221 May 27 16:32:17.686901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 269/532] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:17 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:17.784313 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:17.784931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:17.792571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:17.793023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:17.793848 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:17.794306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:18.000608 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:18.008761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-68edb17a-5c60-4809-a72d-655270fd6170 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.228330 May 27 16:32:18.014157 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 270/533] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:17 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:18.015336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:18.015625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:18.021717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:18.022161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:18.022923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:18.023355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:18.111637 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:18.121053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d8ecba82-825d-42d9-8a52-a4bd4958c2c1 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1266 microversion: 2.1 time: 0.109455 May 27 16:32:18.123669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 271/534] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:18 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:18.281633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d1b79133-204e-4dbd-9e6b-addacca8c330 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.220545 May 27 16:32:18.282431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 264/535] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:32:09 2022] POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments => generated 194 bytes in 9222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:18.706847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:18.707380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:18.714485 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:18.715045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:18.715804 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:18.716231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:18.853505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:18.862235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:18.864906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:18.866121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-caf625b3-9985-4853-8615-34120689fb8c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.163409 May 27 16:32:18.867293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 272/536] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:18 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:19.028931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:19.029575 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:19.035931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.036392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:19.037157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.037625 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:19.138433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:19.139048 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:19.145518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.145963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:19.146719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.147147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:19.176607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:19.185018 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7a320e84-c4f8-4133-9695-6e78041c073a tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.161653 May 27 16:32:19.185734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 265/537] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:19 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:19.211888 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:19.219464 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-72739e5a-5fbe-4e09-9fe2-454111c04ea0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1274 microversion: 2.1 time: 0.084802 May 27 16:32:19.219965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 273/538] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:19 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:19.886670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:19.894921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:19.901013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.901601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:19.902476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:19.902921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:20.053182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:20.062592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:20.065229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:20.066426 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a9791413-0080-4ca5-973e-1005c17dbbd9 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.184730 May 27 16:32:20.067165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 266/539] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:19 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:20.202231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:20.202978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:20.210393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:20.210393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:20.212011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:20.212462 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:20.237625 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:20.241181 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:20.246528 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:20.246978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:20.247739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:20.248168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:20.600309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:20.611718 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e998e282-363d-4c2e-989a-c0f859bcd8df tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1272 microversion: 2.1 time: 0.378042 May 27 16:32:20.612997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 267/540] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:20 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:20.674705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:20.683052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f8e1743b-2096-4a48-a462-bd107511f222 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.484729 May 27 16:32:20.683659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 274/541] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:20 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:21.086993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:21.087777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:21.094588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.095077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.095816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.096322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.353170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:21.361598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:21.363168 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:21.364332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1dd86f93-b831-4e7d-b5ae-5df168353191 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.282248 May 27 16:32:21.364889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 268/542] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:21 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:21.631692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:21.632957 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:21.642027 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.642662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.643548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.644114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.700588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:21.701203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:21.707682 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.708291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.709199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:21.709784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:21.907031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:21.916138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2e980c39-77c4-4d2d-82fb-da31cc2bbf25 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.289451 May 27 16:32:21.926889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 275/543] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:21 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:21.991508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:22.000769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-76a67045-54ce-4934-ae43-6c33ad357257 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.303781 May 27 16:32:22.001443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 269/544] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:21 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:22.021591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-fc40cfd0-2850-4ccc-a623-e735a3ace70a req-2710fb36-b22d-4348-8301-3349559a2f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "name": "network-vif-plugged", "status": "completed", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:22.030664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fc40cfd0-2850-4ccc-a623-e735a3ace70a req-2710fb36-b22d-4348-8301-3349559a2f7e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.031096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fc40cfd0-2850-4ccc-a623-e735a3ace70a req-2710fb36-b22d-4348-8301-3349559a2f7e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:22.042949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-fc40cfd0-2850-4ccc-a623-e735a3ace70a req-2710fb36-b22d-4348-8301-3349559a2f7e service nova] Creating event network-vif-plugged:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:32:22.047942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-fc40cfd0-2850-4ccc-a623-e735a3ace70a req-2710fb36-b22d-4348-8301-3349559a2f7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 May 27 16:32:22.048591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 276/545] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:22.144596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-192680ff-e4d8-4d88-8361-1f1275728c45 req-1e95be3d-5888-4c16-9964-90a984315563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d4d34-780e-4e41-9bf0-3df0af46ed2b", "tag": "668dacd1-3d8a-493a-a93f-0e40c15d28d9"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:22.154520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-192680ff-e4d8-4d88-8361-1f1275728c45 req-1e95be3d-5888-4c16-9964-90a984315563 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.154963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-192680ff-e4d8-4d88-8361-1f1275728c45 req-1e95be3d-5888-4c16-9964-90a984315563 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:22.168062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-192680ff-e4d8-4d88-8361-1f1275728c45 req-1e95be3d-5888-4c16-9964-90a984315563 service nova] Creating event network-changed:668dacd1-3d8a-493a-a93f-0e40c15d28d9 for instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b on hv-cinder-84049 May 27 16:32:22.172989 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-192680ff-e4d8-4d88-8361-1f1275728c45 req-1e95be3d-5888-4c16-9964-90a984315563 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037797 May 27 16:32:22.173826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 270/546] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:22.384681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:22.385293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:22.391742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.392280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:22.393065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.393533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:22.531242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:22.543297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:22.544906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:22.547496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-538a48f2-b64a-476e-ba5d-cc6ed5c2eb2f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.167321 May 27 16:32:22.548073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 277/547] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:22 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:22.935716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:22.936336 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:22.942697 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.943210 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:22.943980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:22.944421 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:23.017767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:23.018522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:23.027079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:23.027874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:23.028946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:23.030066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:23.087664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:23.095799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1c542218-7f31-40ce-821a-e2dde06a701a tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.164965 May 27 16:32:23.096369 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 271/548] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:22 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:23.174384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:23.182818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c925d2b6-bdb4-4d14-b924-e3a99d53283e tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.168864 May 27 16:32:23.183384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 278/549] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:23 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:23.566761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:23.567283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:23.569708 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:23.574550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:23.574995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:23.575745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:23.576177 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:23.709925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:23.719995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:23.721552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:23.722762 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8f9353b5-c3ce-444c-a37f-05d494fa2cf0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.159937 May 27 16:32:23.723988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 272/550] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:23 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:24.070618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-4ad20d77-f3bf-4887-8947-e8f9427c79fc req-617a2279-abea-4bb4-a629-d0cbd8e1b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "name": "network-vif-plugged", "status": "completed", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:24.079533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-4ad20d77-f3bf-4887-8947-e8f9427c79fc req-617a2279-abea-4bb4-a629-d0cbd8e1b842 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.079904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-4ad20d77-f3bf-4887-8947-e8f9427c79fc req-617a2279-abea-4bb4-a629-d0cbd8e1b842 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.092378 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-4ad20d77-f3bf-4887-8947-e8f9427c79fc req-617a2279-abea-4bb4-a629-d0cbd8e1b842 service nova] Creating event network-vif-plugged:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:32:24.097141 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-4ad20d77-f3bf-4887-8947-e8f9427c79fc req-617a2279-abea-4bb4-a629-d0cbd8e1b842 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 May 27 16:32:24.097977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 279/551] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:24.114507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:24.114507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:24.122430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.123069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.124021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.124460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.201232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:24.202271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:24.208719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.209166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.209972 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.210405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.296526 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:24.305380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d0643cc1-2de9-4a77-bced-429df9c81736 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.196063 May 27 16:32:24.306150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 273/552] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:24 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:24.372630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:24.380891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4a9fc8b6-c7ed-4fa5-aa36-224c9d681f65 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.183707 May 27 16:32:24.381570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 280/553] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:24 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:24.740793 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:24.741425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:24.748335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.748828 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.749609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:24.750044 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:24.883862 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:24.892537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:24.894034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:24.895182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-49c25a1c-909f-4d13-bf7d-1da5cc6695db tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.158316 May 27 16:32:24.895751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 274/554] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:24 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:25.323840 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:25.324635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:25.331670 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.332186 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.332950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.333415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.398218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:25.399313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:25.405595 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.406163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.406970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.407417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.515853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:25.524247 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ae73741f-4c94-4f77-96ba-d237a75ca1ac tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.204567 May 27 16:32:25.533841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 281/555] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:25 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:25.559587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:25.567222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e4e2a892-b676-4ee1-97be-0cf61dd4b317 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.173031 May 27 16:32:25.567806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 275/556] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:25 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:25.908209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:25.908616 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:25.914357 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:25.915013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.915124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:25.915453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.916203 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.916774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.921779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.922235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:25.923007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:25.923445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:26.063555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lazy-loading 'services' on Instance uuid 5220d569-8535-429a-bfff-fa0955dec2c0 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:26.095693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:26.105581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:26.107317 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:26.108501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1135e0cd-e13e-4cc2-8f88-330540a2219a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1807 microversion: 2.20 time: 0.198237 May 27 16:32:26.109066 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 276/557] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:25 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:32:26.347694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-88aad793-5d9b-4348-8263-4d353f7e98f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments/50d0e9b6-b961-47dd-817c-7dd8f0ab0b30" status: 202 len: 0 microversion: 2.1 time: 0.444308 May 27 16:32:26.348289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 282/558] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:32:25 2022] DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments/50d0e9b6-b961-47dd-817c-7dd8f0ab0b30 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:32:26.542487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:26.543108 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:26.549361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:26.549825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:26.550608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:26.551035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:26.586897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:26.587239 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:26.593831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:26.594275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:26.595043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:26.595472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:26.733308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:26.741407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-beecc140-c0f7-47ad-ac47-3192b8880c86 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.203478 May 27 16:32:26.742535 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 277/559] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:26 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:26.765882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:26.774777 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bf4d9ec5-f4ed-41cb-a2ac-d4e61655ff64 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.192933 May 27 16:32:26.775781 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 283/560] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:26 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:27.128378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:27.128980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:27.136865 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.137308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.138085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.138516 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.290815 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:27.300063 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:27.301580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:27.302734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d8a2978e-1cf9-43be-bf65-d09e0c15fe60 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1794 microversion: 2.20 time: 0.178560 May 27 16:32:27.303289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 278/561] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:32:27 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:32:27.759072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:27.759613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:27.766144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.766584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.767349 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.767748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.792912 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:27.793554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:27.812410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.812838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.813646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:27.814077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:27.961450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:27.977769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f66f91e6-3755-43d9-aa7f-76d0509cc4f8 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.222508 May 27 16:32:27.978434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 284/562] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:27 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:28.009531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:28.017139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5d34a811-dcd7-4f29-85bb-b31b583560e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.229245 May 27 16:32:28.017851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 279/563] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:27 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:28.995613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:28.996221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:29.002707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:29.003138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:29.003898 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:29.004330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:29.038770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:29.040578 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:29.048171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:29.048617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:29.049409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:29.049848 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:29.189721 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:29.197380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d69a39e5-3451-4c05-aff3-7224e46f4296 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.206697 May 27 16:32:29.197949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 285/564] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:28 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:29.218750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:29.227915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-45b55e49-1bf1-40d4-ae6c-42b478e65d01 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1359 microversion: 2.1 time: 0.191437 May 27 16:32:29.227915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 280/565] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:29 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:30.053238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:30.055108 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:30.061890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.062695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.063453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.064235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.079481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:30.108584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'flavor' on Instance uuid 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:30.114249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-913411239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-310070568", "security_groups": [{"name": "tempest-secgroup-smoke-613814716"}], "networks": [{"uuid": "aa09204f-d5e0-4070-bdf8-f62fd6cd31b6"}], "block_device_mapping_v2": [{"uuid": "e91d320a-3877-4240-9192-418885a30e09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:30.241103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] validate_networks() for [('aa09204f-d5e0-4070-bdf8-f62fd6cd31b6', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:32:30.534277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5c14e429-55cb-487d-9f4c-164036d00124 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/action" status: 200 len: 32 microversion: 2.1 time: 0.484271 May 27 16:32:30.534567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 286/566] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:32:30 2022] POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:32:30.541902 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-74bc16e6-e890-4012-9187-f4f4be5dc0a5 req-46dfb90a-c77d-44ab-87e5-24930b945f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d4d34-780e-4e41-9bf0-3df0af46ed2b", "name": "network-vif-plugged", "status": "completed", "tag": "668dacd1-3d8a-493a-a93f-0e40c15d28d9"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:30.552610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-74bc16e6-e890-4012-9187-f4f4be5dc0a5 req-46dfb90a-c77d-44ab-87e5-24930b945f39 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.553051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-74bc16e6-e890-4012-9187-f4f4be5dc0a5 req-46dfb90a-c77d-44ab-87e5-24930b945f39 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.567531 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-74bc16e6-e890-4012-9187-f4f4be5dc0a5 req-46dfb90a-c77d-44ab-87e5-24930b945f39 service nova] Creating event network-vif-plugged:668dacd1-3d8a-493a-a93f-0e40c15d28d9 for instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b on hv-cinder-84049 May 27 16:32:30.573114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-74bc16e6-e890-4012-9187-f4f4be5dc0a5 req-46dfb90a-c77d-44ab-87e5-24930b945f39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036415 May 27 16:32:30.573788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 287/567] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:30.578625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:30.579321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:30.589323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.589784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.590564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.591001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.657169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:32:30.657947 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:32:30.666139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:32:30.666139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:32:30.666139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:32:30.671656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.672103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.672893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.673323 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.681851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:30.693185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Getting quotas for project e57270a9020844e9baf044630fb81bcd. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:32:30.698015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Getting quotas for user 672b81726d1445518823f6e7c8887978 and project e57270a9020844e9baf044630fb81bcd. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:32:30.757066 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:30.778934 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4ca11293-0df0-43ca-aa85-8f3bed023788 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.204005 May 27 16:32:30.788326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 288/568] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:30 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:30.788707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:32:30.788838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:30.788838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:30.790011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e91d320a-3877-4240-9192-418885a30e09',volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:32:30.795041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.795469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.796319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:30.796754 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:30.990948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.000119 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2a16cb0c-43d4-474c-b0f4-46c8852bb04d tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1550 microversion: 2.1 time: 0.218998 May 27 16:32:31.000945 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 289/569] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:30 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:31.005835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.006841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.013913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.013913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.014776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.015397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.152153 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.160458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c9923ecf-77be-4ea7-8be0-ed68fa46789c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.158644 May 27 16:32:31.161049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 290/570] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:31.166080 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.166705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.173801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.173801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.174207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.174631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.305612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2f4c9f77-96bd-4a1c-af14-78da0bd6b99b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.195141 May 27 16:32:31.307187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 281/571] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:32:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 16:32:31.315262 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.317813 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7e1e7ef3-a957-4938-bb80-745b83c9e481 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.318566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7e1e7ef3-a957-4938-bb80-745b83c9e481 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.324327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-11032173-0ce9-47a1-8710-425b525b1f38 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1550 microversion: 2.1 time: 0.162240 May 27 16:32:31.325258 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 291/572] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:31.351696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.356092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.362991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Searching by: {'deleted': False, 'project_id': 'bf8f192a31204d97b3b2e8895856a459'} {{(pid=118487) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 16:32:31.363917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.364362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.365148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.365600 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.413283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7e1e7ef3-a957-4938-bb80-745b83c9e481 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.421625 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7e1e7ef3-a957-4938-bb80-745b83c9e481 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1087 microversion: 2.1 time: 0.107917 May 27 16:32:31.423617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 282/573] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1087 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:31.475816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.multi_cell_list [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 16:32:31.578759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-701c94e6-0438-48dd-be23-7f731c1244d4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.233228 May 27 16:32:31.579074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 292/574] 10.222.0.42 () {58 vars in 1124 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:31.590384 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.591246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.597178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.597724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.598452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.598891 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.691621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6f898377-1983-4208-a746-a920f525d2c2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:31.699415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f898377-1983-4208-a746-a920f525d2c2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.699865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f898377-1983-4208-a746-a920f525d2c2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.722850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6f898377-1983-4208-a746-a920f525d2c2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Going to try to stop instance {{(pid=118487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 16:32:31.734844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.743009 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-12776317-5fa1-495f-b67c-6c5836fc5847 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1550 microversion: 2.1 time: 0.156894 May 27 16:32:31.744049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 283/575] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:31.795296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.795950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.801963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.802554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.808842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.808842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.959098 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6f898377-1983-4208-a746-a920f525d2c2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.270900 May 27 16:32:31.960105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 293/576] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:32:31 2022] POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:32:31.962388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:31.968837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:31.969705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:31.971249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a9480137-c64c-436a-8285-44789ee9df47 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.179653 May 27 16:32:31.972001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 284/577] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:31.983927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.984376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:31.985694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:31.986277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:32.127548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:32.135639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cd456e4a-6a48-40b5-879a-3690f40d5d23 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.170815 May 27 16:32:32.136521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 294/578] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:31 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:32.178401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:32.179011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:32.186390 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:32.186845 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:32.187600 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:32.188037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:32.332801 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:32.341511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b0e6a95c-707b-403c-a6c3-73a3b9fb214a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.166898 May 27 16:32:32.342082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 285/579] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:32 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:32.438884 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1cbf8c83-21a8-403b-b363-dd627f8a991d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:32.439480 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1cbf8c83-21a8-403b-b363-dd627f8a991d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:32.491837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1cbf8c83-21a8-403b-b363-dd627f8a991d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:32.499369 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1cbf8c83-21a8-403b-b363-dd627f8a991d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1087 microversion: 2.1 time: 0.064278 May 27 16:32:32.499935 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 295/580] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:32 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:32.989438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:32.990416 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:32.998173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:32.998626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:32.999392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:32.999836 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.130310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:33.138799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2502c1ff-c493-43b0-9602-5c85f2d8e1f0 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1314 microversion: 2.1 time: 0.154429 May 27 16:32:33.139366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 286/581] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:32 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:33.153329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:33.153957 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:33.161002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.161497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.162253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.162688 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.296847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:33.304435 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b647ac2a-ada3-4658-87e0-7c5029e7d4e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.155014 May 27 16:32:33.305001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 296/582] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:33 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:33.359205 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:33.359838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:33.366428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.366948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.367720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.368163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.499754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:33.507825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2e407cfd-7a8d-4b71-a5e1-4ea1a4877472 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.152482 May 27 16:32:33.508630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 287/583] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:33 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:33.517759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:33.518445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:33.524649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.525123 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.526544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.526978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.590694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:33.598445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f4017114-fcb4-4e7a-b7a7-447d40811db0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1185 microversion: 2.1 time: 0.085734 May 27 16:32:33.599021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 297/584] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:33 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:33.884017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bce785d-d439-4226-8be1-a003c9ff658a"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:33.885179 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:33.892179 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.892780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:33.894074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:33.894521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.155469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:34.156073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:34.165056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.165056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.165056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.165056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.304238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:34.312226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c72b3303-6e55-40ff-ae97-2a14b04f3dc4 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1498 microversion: 2.1 time: 0.160430 May 27 16:32:34.312813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 298/585] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:34 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:34.324551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:34.327756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:34.331439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.331862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.332677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.333357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.473843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:34.482382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-74371cbe-b654-42ff-9eec-e6ae41ca244c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.162214 May 27 16:32:34.482973 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 299/586] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:34 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:34.524568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:34.525182 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:34.531297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.531740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.532561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.532993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.673125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:34.681441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e794eed5-4a3b-4119-9540-5a3c4ebebe67 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.160781 May 27 16:32:34.682006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 300/587] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:34 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:34.686931 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:34.687536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:34.693293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.693769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.694518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:34.694944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:34.710421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:34.759158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:34.767057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7b23d480-79dc-42ff-b7b9-db97c650c32e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1185 microversion: 2.1 time: 0.084006 May 27 16:32:34.767624 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 301/588] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:34 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:35.401327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:35.402074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:35.409110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.409594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.410403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.411000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.440571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:32:35.454024 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-88069a93-9772-40d0-87b2-f20b25a78a22 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.573447 May 27 16:32:35.457517 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 288/589] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:32:33 2022] POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments => generated 194 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:35.501235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:35.502147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:35.509235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.510491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.512068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.512895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.663392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:35.672925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-90987ecc-9f62-4ebd-8343-32a7aefd0eca tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.175571 May 27 16:32:35.673548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 289/590] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:35 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:35.699038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:35.700268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:35.712812 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.713950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.714077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.715275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.838211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e969abad-5d51-45d0-9eb2-46331baf2b71 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 204 len: 0 microversion: 2.1 time: 0.441964 May 27 16:32:35.840248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 302/591] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:32:35 2022] DELETE /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 16:32:35.847017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:35.847707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:35.854237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.854670 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.855879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.856314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.866880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:35.877412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-727b78b2-f82d-47ae-8973-2dc7184388cf tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.182631 May 27 16:32:35.877973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 290/592] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:35 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:35.893497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:35.894476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:35.900972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.901724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.902690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:35.903289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:35.928093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:35.946735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e7aa8469-650f-4376-b2e5-11e7a7f0651f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1203 microversion: 2.1 time: 0.101018 May 27 16:32:35.946735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 303/593] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:35 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:36.043764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:36.051738 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5ab810fe-43d6-4319-9846-204600e42d44 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1504 microversion: 2.1 time: 0.162018 May 27 16:32:36.061953 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 291/594] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:35 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:36.691989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:36.692509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:36.700072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.700515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:36.701268 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.701740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:36.832174 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:36.840284 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e7c05bf0-3d82-4c3d-90dc-cca0e2b9228d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.152519 May 27 16:32:36.840962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 304/595] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:36 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:36.895853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:36.896465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:36.904476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.904925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:36.910033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.910033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:36.961667 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:36.962194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:36.969284 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.969764 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:36.970521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:36.970947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:37.078714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:37.086820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eb05299c-301c-404e-9a4e-49163c516442 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.194752 May 27 16:32:37.087407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 292/596] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:36 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:37.093194 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:37.093925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:37.099788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:37.100245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:37.101025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:37.101491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:37.124823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:37.132412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-87fbbb23-a260-4913-8227-7be698dba12f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1270 microversion: 2.1 time: 0.174609 May 27 16:32:37.132994 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 305/597] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:36 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:37.233549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:37.241148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b23b0a06-8bae-4112-b68b-d7869cc690f7 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1504 microversion: 2.1 time: 0.152784 May 27 16:32:37.241873 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 293/598] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:37 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:37.858478 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:37.859492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:37.869812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:37.870787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:37.871923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:37.872415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.105320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:38.105963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:38.113042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.113531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.114359 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.114832 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.131499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:38.141192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ea3c7d15-531b-44bb-aec6-38b63b9ce3d5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.288062 May 27 16:32:38.151256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 306/599] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:37 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:38.156565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:38.157380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:38.163540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.164100 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.164965 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.165534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.352737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:38.363207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d7335997-720b-43e4-82c2-93eadcb876db tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.262095 May 27 16:32:38.375028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 294/600] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:38 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:38.384181 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-24e2a465-3e20-46ea-bb29-408c7988c72b req-1b09af48-32ed-4230-af58-090af6c1d08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:38.396603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-24e2a465-3e20-46ea-bb29-408c7988c72b req-1b09af48-32ed-4230-af58-090af6c1d08d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.396603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-24e2a465-3e20-46ea-bb29-408c7988c72b req-1b09af48-32ed-4230-af58-090af6c1d08d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.410364 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-24e2a465-3e20-46ea-bb29-408c7988c72b req-1b09af48-32ed-4230-af58-090af6c1d08d service nova] Creating event network-changed:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:32:38.415426 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-24e2a465-3e20-46ea-bb29-408c7988c72b req-1b09af48-32ed-4230-af58-090af6c1d08d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037460 May 27 16:32:38.416041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 295/601] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:38.422284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:38.423008 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:38.429836 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.430290 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.431146 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.431588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.452941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:38.461390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-13eb28a6-8d16-4cfd-ad82-fa3906e4f71c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.308435 May 27 16:32:38.462706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 307/602] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:38 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:38.498617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-0b23fc76-24e9-460c-88c5-71871228211c req-32e95d3e-646d-4b98-be3d-044dea1d456f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d4d34-780e-4e41-9bf0-3df0af46ed2b", "name": "network-vif-deleted", "tag": "668dacd1-3d8a-493a-a93f-0e40c15d28d9"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:38.508154 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0b23fc76-24e9-460c-88c5-71871228211c req-32e95d3e-646d-4b98-be3d-044dea1d456f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:38.508606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0b23fc76-24e9-460c-88c5-71871228211c req-32e95d3e-646d-4b98-be3d-044dea1d456f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:38.524312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-0b23fc76-24e9-460c-88c5-71871228211c req-32e95d3e-646d-4b98-be3d-044dea1d456f service nova] Creating event network-vif-deleted:668dacd1-3d8a-493a-a93f-0e40c15d28d9 for instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b on hv-cinder-84049 May 27 16:32:38.530470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-0b23fc76-24e9-460c-88c5-71871228211c req-32e95d3e-646d-4b98-be3d-044dea1d456f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036567 May 27 16:32:38.531665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:38.531918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 308/603] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:38.541037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d9881cf8-8e92-40c6-83cb-a4c1bf55c0da tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1462 microversion: 2.1 time: 0.123458 May 27 16:32:38.541923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 296/604] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:38 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:39.159855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:39.160472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:39.166714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.167176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.167944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.168661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.309236 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:39.317285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-307229b3-ccec-4d23-9cb8-a96655bda8dd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.162214 May 27 16:32:39.317904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 309/605] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:39 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:39.380842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:39.381551 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:39.388383 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.388830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.389795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.390237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.477910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:39.478512 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:39.480472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.485360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.485995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.486799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.487310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.537208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:39.545737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0c9f8a55-382a-4e9c-82ab-c03dac1d5b21 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.168875 May 27 16:32:39.546399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 297/606] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:39 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:39.562211 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:39.562803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:39.569512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.570089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.570750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.571187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.610334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:39.610787 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:39.611242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lazy-loading 'fault' on Instance uuid 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:39.613430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.858780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c3e6bd775848f39176015d42749fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1194991899d4dd5ac974608165516b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:39.867329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-15eb0996-c9c9-4ad1-8bcc-b6f841a3af9f tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 200 len: 1304 microversion: 2.1 time: 0.310028 May 27 16:32:39.868112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 298/607] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:39 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 1304 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:39.962655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:39.972505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ed3cd5fa-38aa-4b60-a4cf-c751f311d4ec tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.498278 May 27 16:32:39.973404 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 310/608] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:39 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:40.339104 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:40.340750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:40.352229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.356447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.356447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.356447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.533709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:40.541260 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25e1f11a-bafe-491d-9c28-ff786ca4bb78 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.209824 May 27 16:32:40.541856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 299/609] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:40 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:40.562906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:40.563602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:40.570359 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.570810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.571568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.572002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.706140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:40.714255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bb78658e-d926-444c-bb2e-c85d13fdc4a2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.155361 May 27 16:32:40.715471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 311/610] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:40 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:40.885133 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:40.885777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] [instance: 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:40.888821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:40.893873 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.894331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.895105 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.895543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:40.909958 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] HTTP exception thrown: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Request method failure captured: May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b HTTP/1.1 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPzLLdPMA95hSVG-blfLzM9kposITdImxZW01ffi3_tVBtNi3QVaB1RysbSD0AtiStm0ckqlrKmETDghf25jGawciZD_5euLzKoEaROMRL7BXsH0NPwIrdxilbQSot2l_l3rx4qSlf9ofo69EDC4vY3WnWZWU2fWL70ud5sP_nvG-wg May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: e1194991899d4dd5ac974608165516b8 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesActionsTest-904608882 May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:32:40.911607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1194991899d4dd5ac974608165516b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1194991899d4dd5ac974608165516b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1194991899d4dd5ac974608165516b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1194991899d4dd5ac974608165516b8", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesActionsTest-904608882 May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: e1194991899d4dd5ac974608165516b8 May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesActionsTest-904608882 May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesActionsTest-904608882-project May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 97c3e6bd775848f39176015d42749fa2 May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesActionsTest-904608882-project May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. May 27 16:32:40.913285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '6f6d4d34-780e-4e41-9bf0-3df0af46ed2b'} May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:32:40.914131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. May 27 16:32:40.915543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:32:40.916602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] Returning 404 to user: Instance 6f6d4d34-780e-4e41-9bf0-3df0af46ed2b could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:32:40.916602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-28cb417d-0e69-444a-93d6-62b93cb1c836 tempest-VolumesActionsTest-904608882 tempest-VolumesActionsTest-904608882-project] 10.222.0.42 "GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b" status: 404 len: 111 microversion: 2.1 time: 0.031870 May 27 16:32:40.916602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 300/611] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:40 2022] GET /compute/v2.1/servers/6f6d4d34-780e-4e41-9bf0-3df0af46ed2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:32:40.989593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:40.990208 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:40.998878 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:40.999358 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.000194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:41.000655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.135243 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:41.144441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-935ad6df-8540-4b98-9807-881156417852 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.158598 May 27 16:32:41.145223 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 312/612] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:40 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:41.560048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:41.560608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:41.563609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=8 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.569784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:41.570239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.571009 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:41.571549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.733749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:41.837582 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:41.837688 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:41.837808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.837808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:41.837808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.837808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:41.838172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:41.838261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-09fd181e-74af-4e55-83da-2a81218843f5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.189785 May 27 16:32:41.838261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 301/613] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:41 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:41.883989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:41.894620 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d0b3718c-2a0c-494d-8183-05ac1a794b0d tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.165926 May 27 16:32:41.895203 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 313/614] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:41 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:42.162141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:42.162759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:42.174804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.175255 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:42.176068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.176504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:42.324661 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:42.332696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7cde7752-1e16-42a1-ae3a-ab35086ea2ae tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.174076 May 27 16:32:42.340872 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 302/615] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:42 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:42.830983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:42.831876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:42.833647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:42.839229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.839790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:42.840570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.841000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:42.914419 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:42.915220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:42.923869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.924694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:42.925932 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:42.926601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.034568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:43.042048 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-81a445af-8018-4eb2-925d-7ce74546d266 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1677 microversion: 2.1 time: 0.215256 May 27 16:32:43.043177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 314/616] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:42 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:43.094492 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:43.102439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c08d3da0-591e-4a05-8032-1fbb0934f67c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.194441 May 27 16:32:43.102999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 303/617] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:42 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:43.353836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:43.354448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:43.361551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.361995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.362755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.363186 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.499768 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:43.507299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ee2b8ef3-264c-47d4-baf9-47b3d1d62b2d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.157550 May 27 16:32:43.507794 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 315/618] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:43 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:43.891128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:43.891667 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:43.897777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.898220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.898966 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.899397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.921686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4315afe8-c38d-47e8-8d20-bd9602896f45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/ips" status: 200 len: 147 microversion: 2.1 time: 0.035044 May 27 16:32:43.922331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 304/619] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:32:43 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:43.932728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73580451-62d0-415e-ac60-bba51dc95385"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:43.934527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:43.941480 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.943758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:43.943758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:43.943758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.030911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: POST /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/os-volume_attachments HTTP/1.1 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 74 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:32:44.032666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {"volumeAttachment": {"volumeId": "73580451-62d0-415e-ac60-bba51dc95385"}} May 27 16:32:44.034146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'server_id': 'a6f4d9f6-9829-4b8d-96f2-982a04b2851f', 'body': {'volumeAttachment': {'volumeId': '73580451-62d0-415e-ac60-bba51dc95385'}}} May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:44.035088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:44.036524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 400 to user: Invalid volume: volume 73580451-62d0-415e-ac60-bba51dc95385 is already attached to instances: 3034be98-8230-4ba1-bfd9-cb4e4cf776af {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ab3f9415-606a-4159-8f39-b093a1f11d0f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105419 May 27 16:32:44.038912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 316/620] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:32:43 2022] POST /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 16:32:44.043553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.044207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.050868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.051323 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.052093 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.052540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.059724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.060537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.068158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.068158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.069059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.069059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.073151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:44.079454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:32:44.207463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:44.211275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cfb9c3e9-1508-44d9-b249-ddfe269cb5d1 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1654 microversion: 2.1 time: 0.156006 May 27 16:32:44.211856 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 317/621] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:44 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:44.216591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.217189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.223178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.223719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.224484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.224915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.358036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:44.367288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1c8b6742-3b6d-42cc-b74b-f7bafddeb5d1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.154431 May 27 16:32:44.367864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 318/622] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:44 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:44.373185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-196b49ed-1a44-40d8-8ec8-b707a1df8043 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:44.379093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-196b49ed-1a44-40d8-8ec8-b707a1df8043 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.379539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-196b49ed-1a44-40d8-8ec8-b707a1df8043 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.403377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-196b49ed-1a44-40d8-8ec8-b707a1df8043 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Going to try to start instance {{(pid=118487) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 16:32:44.460901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-af4072e3-53ac-42df-8c39-5e109076951f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 204 len: 0 microversion: 2.1 time: 0.421282 May 27 16:32:44.461547 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 305/623] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:32:44 2022] DELETE /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:32:44.471565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.472247 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.478686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.479120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.479880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.480977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.628410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:44.638505 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2dc594e2-30f3-4fa0-89c8-8ec2619d3778 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.171163 May 27 16:32:44.639076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 306/624] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:44 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:44.643694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.644295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.650990 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.651433 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.652271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.652816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.733313 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-196b49ed-1a44-40d8-8ec8-b707a1df8043 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.363859 May 27 16:32:44.734400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 319/625] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:32:44 2022] POST /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:32:44.747954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:44.749131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:44.756937 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.757407 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.758183 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:44.758610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:44.797270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:44.803884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f2523274-0739-4d51-93b8-f6392b252b41 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.163809 May 27 16:32:44.804458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 307/626] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:44 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:44.900396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:44.908373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1155f4cb-f9b6-4823-9c29-d343ee603d5f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.168462 May 27 16:32:44.908952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 320/627] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:44 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:45.385749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:45.386980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:45.393845 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.394293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.395074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.395522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.538972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:45.547488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2fd6aa07-862f-42b7-b2f8-a643fd19cad4 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.165534 May 27 16:32:45.548066 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 308/628] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:45 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:45.656216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:45.656753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:45.663271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.663718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.664472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.664913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.798829 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:45.806453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-45c60200-c762-4b65-bfc0-222fd5a9b61a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.154289 May 27 16:32:45.807018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 321/629] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:45 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:45.821380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:45.822015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:45.824259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:45.828997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.829555 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.833120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.833120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.924926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:45.929283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:45.931963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.932411 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.933227 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:45.933743 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:45.983838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:45.997546 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7fcdf66-d543-4857-b80e-838cfbe4cacf tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.179628 May 27 16:32:45.997997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 309/630] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:45 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:46.067583 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:46.075717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-14e06ec4-2328-46ec-a36a-f10a11cd7621 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.154539 May 27 16:32:46.076275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 322/631] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:45 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:46.564951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:46.565578 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:46.572002 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:46.572447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:46.573200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:46.573665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:46.714243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:46.722944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-591ca523-8a87-4905-8f0a-e95dc61db582 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.161790 May 27 16:32:46.723529 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 310/632] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:46 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:46.824726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:46.825568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:46.832182 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:46.832617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:46.833408 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:46.833839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:46.966324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:46.973864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c65e105a-12a1-4bab-baee-9cc2670dae23 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.153609 May 27 16:32:46.974450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 323/633] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:46 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:47.014936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:47.015541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:47.021594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.022041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.022802 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.023235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.092834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:47.093694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:47.102753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.103204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.103992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.104476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.184873 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:47.202095 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2fbfd238-0985-4b08-b881-143998cf7c23 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.191618 May 27 16:32:47.202881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 311/634] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:47 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:47.250302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:47.257839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ab7deaae-28d7-4f39-8058-1c335438fff5 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.169688 May 27 16:32:47.258404 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 324/635] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:47 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:47.740957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:47.741601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:47.749070 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.749554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.750320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.750753 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:47.888549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:47.899737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4edd2fc3-6c84-40f2-8661-828849d5c297 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.162488 May 27 16:32:47.900338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 312/636] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:47 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:47.992329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:47.992924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:47.999508 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:47.999950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.000735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.001146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.145834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:48.153363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-23cc1694-3e06-4363-967a-737d706dc91e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.165404 May 27 16:32:48.153981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 325/637] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:47 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:48.219201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:48.219903 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:48.226869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.227340 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.228155 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.240480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.275828 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:48.276573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:48.285063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.285671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.286699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.287352 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.486000 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:48.500286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2d8fc7f9-3f40-4999-819a-5107d727f3a9 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.285194 May 27 16:32:48.501454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 313/638] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:48 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:48.505919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:48.518011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e57528b5-dd7a-41b0-b2c9-7cbf3e963c89 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.245969 May 27 16:32:48.520165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 326/639] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:48 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:48.919222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:48.919836 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:48.926912 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.927658 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.936608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:48.937138 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:48.959791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:49.108835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:49.117996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5415d273-c2bc-41c7-974b-2fb9b28471f5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.203801 May 27 16:32:49.118730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 314/640] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:48 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:49.174867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:49.178003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:49.191067 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.192099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.193889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.194935 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.354838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:49.374708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9b348327-baa3-463e-bf62-35796bac384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.206236 May 27 16:32:49.375311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 327/641] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:49 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:49.519137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:49.519811 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:49.526631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.528333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.529232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.529926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.537299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:49.539518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:49.560116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.561167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.563277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:49.563983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:49.716945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:49.726681 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4444accb-6555-46ef-9d21-d26095a950e0 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.211719 May 27 16:32:49.738690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 315/642] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:49 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:49.789470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:49.804901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7b57e5c0-30df-4b9d-a2a0-eacfe4481280 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.270793 May 27 16:32:49.807212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 328/643] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:49 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:50.144754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:50.149491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:50.161273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.162788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.163881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.164522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.375634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:50.384961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4fc2284e-8ab0-4145-bdd5-6446d96cac8b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.244740 May 27 16:32:50.386286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 316/644] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:50 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:50.400941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:50.403602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:50.431124 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.431864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.433197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.434409 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.668127 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:50.680197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-15950b64-9bcd-4afe-8f10-1fbc8859536d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.287860 May 27 16:32:50.681896 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 329/645] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:50 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:50.745314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:50.746779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:50.753699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.754143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.754921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.755333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.825711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:50.826618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:50.833789 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.835112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:50.836183 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:50.836860 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.099422 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:51.110278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-caa06cf0-a27e-48ae-964d-9955bb9bccf5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.369168 May 27 16:32:51.111953 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 317/646] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:50 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:51.164857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:51.174513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f36a6f93-a6b7-4d76-84d0-5eb67f4d2113 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.352952 May 27 16:32:51.178431 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 330/647] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:50 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:51.411976 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:51.412943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:51.429019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.429019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.429019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.429019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.701294 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:51.702550 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:51.714407 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.719239 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.720288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.720733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.765058 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:51.775096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bcbf931a-9ae9-49a4-be0d-613549d10cca tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.366845 May 27 16:32:51.782026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 318/648] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:51 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:51.798635 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:51.799669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:51.806905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.808163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:51.810082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:51.810740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.085664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:52.087436 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:52.104343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-18a96410-20e4-456c-93e3-3cd9c0d3785f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1596 microversion: 2.1 time: 0.318318 May 27 16:32:52.104845 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-be5863b8-652f-4b4a-a97a-ffc1dd6051a3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1678 microversion: 2.1 time: 0.407632 May 27 16:32:52.106022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 319/649] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:51 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1596 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:52.108301 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 331/650] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:51 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1678 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:52.132707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:52.133743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:52.142148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.143567 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.145595 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.146547 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.196800 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:52.197569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:52.213023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.213720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.215687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.216485 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.554302 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:52.564050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a2f5a636-e585-419c-b44c-0f2e5a5a330c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.436763 May 27 16:32:52.568067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 320/651] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:52 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:52.683054 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:52.690622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:52.708318 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d61305d4-5b2e-474a-8014-45e7fa09cc08 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1663 microversion: 2.1 time: 0.513784 May 27 16:32:52.710248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 332/652] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:52 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1663 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:52.774126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-c2a4d5a7-f1c6-46b0-a976-00784b57b198 req-e50d454f-3693-4d62-ba78-ba358e0da4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "name": "network-vif-plugged", "status": "completed", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:52.803640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:52.806259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:52.827908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c2a4d5a7-f1c6-46b0-a976-00784b57b198 req-e50d454f-3693-4d62-ba78-ba358e0da4b6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.838486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c2a4d5a7-f1c6-46b0-a976-00784b57b198 req-e50d454f-3693-4d62-ba78-ba358e0da4b6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.839886 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.840535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.842103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.846288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.854659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-c2a4d5a7-f1c6-46b0-a976-00784b57b198 req-e50d454f-3693-4d62-ba78-ba358e0da4b6 service nova] Creating event network-vif-plugged:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:32:52.864812 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-c2a4d5a7-f1c6-46b0-a976-00784b57b198 req-e50d454f-3693-4d62-ba78-ba358e0da4b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096082 May 27 16:32:52.867454 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 321/653] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:52.880564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-9755370a-2cad-4159-8b4d-bbb0071046e8 req-5a76a9ed-ed8d-48c9-b5da-3303fd4889e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4d9f6-9829-4b8d-96f2-982a04b2851f", "name": "network-vif-deleted", "tag": "bfdd72e1-971a-4ccd-9405-99a3e2b528f6"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:52.914909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-9755370a-2cad-4159-8b4d-bbb0071046e8 req-5a76a9ed-ed8d-48c9-b5da-3303fd4889e1 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:52.918508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-9755370a-2cad-4159-8b4d-bbb0071046e8 req-5a76a9ed-ed8d-48c9-b5da-3303fd4889e1 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:52.962974 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-9755370a-2cad-4159-8b4d-bbb0071046e8 req-5a76a9ed-ed8d-48c9-b5da-3303fd4889e1 service nova] Creating event network-vif-deleted:bfdd72e1-971a-4ccd-9405-99a3e2b528f6 for instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f on hv-cinder-84049 May 27 16:32:52.973512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-9755370a-2cad-4159-8b4d-bbb0071046e8 req-5a76a9ed-ed8d-48c9-b5da-3303fd4889e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103159 May 27 16:32:52.976515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 322/654] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:53.139527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:53.140613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:53.156619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.157224 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.158128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.158680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.315478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:53.325406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c422bfaf-3122-4936-bdd3-2e41851f384f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1611 microversion: 2.1 time: 0.191541 May 27 16:32:53.337945 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:53.348008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-41b7f614-0e50-4ad9-a4b2-23842d47803c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.557605 May 27 16:32:53.348599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 323/655] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:53 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1611 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:53.349651 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 333/656] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:52 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:53.582039 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:53.583778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:53.594808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.602499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.604020 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.614309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.728366 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:53.732510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:53.737688 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.738443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.739397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:53.739985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:53.868597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:53.875580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3ba0024c-f55a-4dda-ac05-cc70478eb15a tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.297761 May 27 16:32:53.876164 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 324/657] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:53 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:54.165008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:54.197299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-560e0be7-02e9-43b5-b6a7-918011b42d9a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1667 microversion: 2.1 time: 0.472895 May 27 16:32:54.199385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 334/658] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:53 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1667 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:54.362287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:54.363110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:54.370469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:54.372326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:54.376955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.376955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.376955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.377489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.400216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.400662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.401484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.401922 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.455265 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.455716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.456185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'fault' on Instance uuid a6f4d9f6-9829-4b8d-96f2-982a04b2851f {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:54.627134 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:54.640901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4dd9804f-a6a6-401f-ae15-1122714fe43a tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 200 len: 1331 microversion: 2.1 time: 0.284881 May 27 16:32:54.644150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 325/659] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:54 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 1331 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:54.747294 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:54.765591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2ff3e9d8-ab4c-4f8e-b852-6badf344185e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.402539 May 27 16:32:54.766627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 335/660] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:54 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:54.896305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:54.896834 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:54.912923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.915902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:54.916704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:54.917143 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:55.461930 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:55.472611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-86f4133e-53ed-4567-bef3-01ca4839bfed tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1258 microversion: 2.1 time: 0.583218 May 27 16:32:55.483309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 326/661] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:54 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1258 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:55.663867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:55.664542 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:55.677214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:55.678411 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:55.679214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:55.680060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:55.702105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f HTTP/1.1 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:32:55.703989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:32:55.705228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'a6f4d9f6-9829-4b8d-96f2-982a04b2851f'} May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:32:55.705985 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:32:55.707184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:32:55.708249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:32:55.708249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-637019a4-f8ab-4b3a-97be-d958c72b49f4 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 404 len: 111 microversion: 2.1 time: 0.047048 May 27 16:32:55.708249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 336/662] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:55 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:32:55.718678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-292cdd79-d792-48e5-bd97-01350bdf95c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '.version_select at 0x7f0e9a026dc0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:55.790754 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:55.791992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:55.804252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:55.805060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:55.806145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:55.806791 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:55.842866 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-292cdd79-d792-48e5-bd97-01350bdf95c8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467720525" status: 202 len: 0 microversion: 2.1 time: 0.128767 May 27 16:32:55.844191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 327/663] 10.222.0.42 () {58 vars in 1220 bytes} [Fri May 27 16:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467720525 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:32:56.064071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:56.074041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-94d9fac9-c816-4926-aef6-0abbc859f034 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.287564 May 27 16:32:56.078136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 337/664] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:55 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:56.492761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:56.498108 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:56.501741 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:56.502504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:56.503586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:56.504371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:56.720995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-5667a798-554d-4d44-b6a3-31fec9958bdf req-68e356cf-e0c5-4441-a432-bb1d6018c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:32:56.742280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5667a798-554d-4d44-b6a3-31fec9958bdf req-68e356cf-e0c5-4441-a432-bb1d6018c09d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:56.742280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5667a798-554d-4d44-b6a3-31fec9958bdf req-68e356cf-e0c5-4441-a432-bb1d6018c09d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:56.768920 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-5667a798-554d-4d44-b6a3-31fec9958bdf req-68e356cf-e0c5-4441-a432-bb1d6018c09d service nova] Creating event network-changed:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:32:56.775541 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-5667a798-554d-4d44-b6a3-31fec9958bdf req-68e356cf-e0c5-4441-a432-bb1d6018c09d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059585 May 27 16:32:56.778165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 338/665] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:56.829822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:56.840380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d70334bd-7b16-43dd-8fe8-043dffed6e34 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1442 microversion: 2.1 time: 0.352265 May 27 16:32:56.863795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:56.865196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:56.870524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 328/666] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:56 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1442 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:56.874713 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:56.875381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:56.876422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:56.877004 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:57.094765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:57.096208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:57.118566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:57.128911 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:57.130387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:57.130992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:57.321040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:57.331585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-022bd2ce-f9e2-4bb6-8e7a-e997b2220137 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1442 microversion: 2.1 time: 0.472478 May 27 16:32:57.332569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 339/667] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:56 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1442 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:57.417401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:57.456999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-95b1d50b-e4a7-4320-9975-fc41a0645da7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.365586 May 27 16:32:57.463094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 329/668] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:57 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:32:58.003932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:58.004470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:58.023292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.030219 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.031598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.032203 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.242664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'services' on Instance uuid 3034be98-8230-4ba1-bfd9-cb4e4cf776af {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:32:58.476629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:58.477216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:58.486788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.487488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.488447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.489039 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.551204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6e7662ed-8f56-4fcf-9eab-6df8d9db5c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments/73580451-62d0-415e-ac60-bba51dc95385" status: 202 len: 0 microversion: 2.1 time: 0.551517 May 27 16:32:58.551873 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 340/669] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:32:57 2022] DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments/73580451-62d0-415e-ac60-bba51dc95385 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:32:58.565265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:58.567137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:58.577411 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.578782 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.580368 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:58.580810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:58.635757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7bf801fd-b7d0-43d0-96ba-500775aed951 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078430 May 27 16:32:58.636893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 341/670] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:32:58 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:32:58.791468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:32:58.812074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-da1b884d-e93e-480a-aa8a-61b07e6e1069 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.338754 May 27 16:32:58.812678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 330/671] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:58 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:32:59.654883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:59.657594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:59.674244 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:59.675437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:59.677163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:59.678171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:59.816148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e95b54cc-93b1-4047-99bc-e16f756844bd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171071 May 27 16:32:59.821414 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 342/672] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:32:59 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:32:59.837093 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:32:59.838301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:32:59.854964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:59.856393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:32:59.858743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:32:59.859745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.559477 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:00.568199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-adce4640-9563-413d-8004-8a69d109aa90 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.740565 May 27 16:33:00.572577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 331/673] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:32:59 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:00.744610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1205888245"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:00.745331 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:00.755212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.756140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.757140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.757907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.831027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:00.831983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:00.838847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.839577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.842169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.842626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.897690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8328ec3a-6fd4-4d9c-983c-b9c0c4550bff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070873 May 27 16:33:00.899130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 332/674] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:33:00 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 16:33:00.976376 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:00.977013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:00.983412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.983856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.984656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:00.985089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:00.987977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:01.017905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:33:01.041375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.network.security_group_api [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Adding security group 6a447d1f-dc4a-436e-b6a0-b6f2fa069b6c to port 3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d May 27 16:33:01.428237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c0be5ca6-9bb3-4a15-8eb2-afe4366e9391 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 204 len: 0 microversion: 2.1 time: 0.455887 May 27 16:33:01.430900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 333/675] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:33:00 2022] DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:33:01.443927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-6c15f4c5-1859-4fa7-8c24-83ad883141dc req-754c72a9-c85e-4615-84dd-d79fafbb9fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:01.448208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6c15f4c5-1859-4fa7-8c24-83ad883141dc req-754c72a9-c85e-4615-84dd-d79fafbb9fa2 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.448906 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6c15f4c5-1859-4fa7-8c24-83ad883141dc req-754c72a9-c85e-4615-84dd-d79fafbb9fa2 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.462661 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-6c15f4c5-1859-4fa7-8c24-83ad883141dc req-754c72a9-c85e-4615-84dd-d79fafbb9fa2 service nova] Creating event network-changed:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:33:01.468893 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-6c15f4c5-1859-4fa7-8c24-83ad883141dc req-754c72a9-c85e-4615-84dd-d79fafbb9fa2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036138 May 27 16:33:01.470197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 334/676] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:01.475924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:01.476948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:01.497681 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.502253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.503562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.504225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.699702 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:01.710400 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-42a249ee-29bf-4782-92da-fba1ff289502 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1682 microversion: 2.1 time: 0.238344 May 27 16:33:01.711566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 335/677] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:01 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:01.717415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:01.718266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:01.724493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.725126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.726098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.726693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.917430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f85b81e5-faa4-4774-b78a-ff6abedd7a48 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action" status: 202 len: 0 microversion: 2.1 time: 1.177576 May 27 16:33:01.921434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 343/678] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:33:00 2022] POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:33:01.927303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:01.934630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:01.945298 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.945774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:01.946546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:01.946984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:02.057026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:02.067664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2dfbc02d-8e77-46d4-871c-5c9c09c64fe5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.354861 May 27 16:33:02.083562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 336/679] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:01 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:02.268869 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:02.286340 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0a27a3f8-fcea-427c-a12d-c1a80d2bd2e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1762 microversion: 2.1 time: 0.362964 May 27 16:33:02.301587 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 344/680] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:01 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1762 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:02.728186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:02.728822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:02.739585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:02.740032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:02.740843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:02.741249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:02.886202 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:02.895227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-51ac7d55-992a-4cc4-9008-832d74ce605f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1682 microversion: 2.1 time: 0.170861 May 27 16:33:02.896140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:02 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:03.092071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:03.093599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:03.101376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:03.102090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:03.103509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:03.104101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:03.261194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:03.270798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f9764a50-0a34-4414-992b-f968b906e23b tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.183144 May 27 16:33:03.271680 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 345/682] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:03 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:03.492874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-84b882e3-e32b-407d-ab5d-c2e3629d9b4b req-5bc3aa3f-4d51-4190-81b4-9c655341b650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:03.502266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-84b882e3-e32b-407d-ab5d-c2e3629d9b4b req-5bc3aa3f-4d51-4190-81b4-9c655341b650 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:03.502981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-84b882e3-e32b-407d-ab5d-c2e3629d9b4b req-5bc3aa3f-4d51-4190-81b4-9c655341b650 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:03.516124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-84b882e3-e32b-407d-ab5d-c2e3629d9b4b req-5bc3aa3f-4d51-4190-81b4-9c655341b650 service nova] Creating event network-changed:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:33:03.521255 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-84b882e3-e32b-407d-ab5d-c2e3629d9b4b req-5bc3aa3f-4d51-4190-81b4-9c655341b650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 May 27 16:33:03.522460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 338/683] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:03.913588 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:03.914391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:03.922769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:03.927370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:03.927370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:03.927370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:04.177746 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:04.187139 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8ce173b4-1a43-47f5-ba40-1e710ada23e6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1682 microversion: 2.1 time: 0.277410 May 27 16:33:04.189688 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 346/684] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:03 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:04.290501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:04.291519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:04.298449 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:04.298830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:04.300940 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:04.301410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:04.452238 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:04.462660 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-79830a22-4675-4f35-82e5-9b68ac0ae966 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.178178 May 27 16:33:04.473246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 339/685] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:04 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:05.205134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:05.206518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:05.213189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:05.213684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:05.214623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:05.215652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:05.450832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:05.461129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6f8cbd4b-5e0f-4bbb-85d9-c1b095f8938d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1682 microversion: 2.1 time: 0.259881 May 27 16:33:05.461954 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 347/686] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:05 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:05.481228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:05.482788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:05.489544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:05.490243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:05.491338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:05.491936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:05.834850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:05.846283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7d134cb8-fa0b-4338-8c22-9de30bf68cd1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.369028 May 27 16:33:05.862725 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 340/687] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:05 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:06.478859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:06.480084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:06.487813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:06.488475 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:06.489467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:06.490063 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:06.570217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:06.579225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8c24f6ad-5eff-4807-ac2a-ea63a7487c89 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1614 microversion: 2.1 time: 0.104059 May 27 16:33:06.585355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 348/688] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:06 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:06.703504 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-da77a761-4c3e-409b-be70-8f807ed48872 req-a1849e86-7aad-4ee4-82f9-05e94b809eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3034be98-8230-4ba1-bfd9-cb4e4cf776af", "name": "network-vif-deleted", "tag": "41c308ca-1a37-4303-834e-73089831b6de"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:06.739037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-da77a761-4c3e-409b-be70-8f807ed48872 req-a1849e86-7aad-4ee4-82f9-05e94b809eac service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:06.739856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-da77a761-4c3e-409b-be70-8f807ed48872 req-a1849e86-7aad-4ee4-82f9-05e94b809eac service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:06.774937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-da77a761-4c3e-409b-be70-8f807ed48872 req-a1849e86-7aad-4ee4-82f9-05e94b809eac service nova] Creating event network-vif-deleted:41c308ca-1a37-4303-834e-73089831b6de for instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af on hv-cinder-84049 May 27 16:33:06.791784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-da77a761-4c3e-409b-be70-8f807ed48872 req-a1849e86-7aad-4ee4-82f9-05e94b809eac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089574 May 27 16:33:06.793597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 341/689] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:06.870410 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:06.871505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:06.886186 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:06.887204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:06.890529 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:06.893248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:07.100635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:07.112324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3215ee2b-cb84-43aa-a8bd-ad77f4015d79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1735 microversion: 2.1 time: 0.248456 May 27 16:33:07.113210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 349/690] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:06 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:07.605065 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:07.606679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:07.615869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:07.616448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:07.617434 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:07.618223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:07.728822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:07.739068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-89e9c969-2af3-474b-894c-b72b1fa4447e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1327 microversion: 2.1 time: 0.144834 May 27 16:33:07.740326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 342/691] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:07 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:08.130816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:08.132328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:08.171297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.172089 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.173133 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.174743 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.209819 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:08.363296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:08.373261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bd7c6992-4b22-4658-a9ed-ee608b617052 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1715 microversion: 2.1 time: 0.245920 May 27 16:33:08.373925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 350/692] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:08 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1715 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:08.503496 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:08.503996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:08.529503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.535946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.535946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.535946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.676669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] HTTP exception thrown: Cannot 'detach_volume' instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f while it is in vm_state rescued May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Request method failure captured: May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments/6ab5ca23-a972-4eee-95d1-7b16c982c31f HTTP/1.1 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxKnJ7-7LWepW6aA4PxHSDnHIjNyWGpXgH1-_edYrDmwcP9bdH7aKowr4kUdkSAX_jQmTs_X5pplHhTuQ4G43mr90Fk-w8GC-TOX1pCF3KDtCbKBjj7UM8tO2yntNq1ueoAF4tawQ7uDeXazOzw2c8K_YD2s9TfkMfOCsDx-4O1kgk May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:33:08.679714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6b6ae55c00cb4a43b8e2bc7df2ea9626", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: cf3e0adc32814585b57bf9f884840fc9 May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:33:08.681415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Cannot 'detach_volume' instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f while it is in vm_state rescued May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'server_id': '2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f', 'id': '6ab5ca23-a972-4eee-95d1-7b16c982c31f'} May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:33:08.682228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f while it is in vm_state rescued May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f while it is in vm_state rescued May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:08.683468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Returning 409 to user: Cannot 'detach_volume' instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f while it is in vm_state rescued {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:33:08.684412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c9e1992e-0f25-4811-95c8-b44d71e53b7a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments/6ab5ca23-a972-4eee-95d1-7b16c982c31f" status: 409 len: 152 microversion: 2.1 time: 0.182136 May 27 16:33:08.684412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 343/693] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:33:08 2022] DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments/6ab5ca23-a972-4eee-95d1-7b16c982c31f => generated 152 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 16:33:08.691310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:08.692232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:08.698741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.699189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.700106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.700556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.757263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:08.757984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:08.775907 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.776539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.778176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.780046 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.837638 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:08.838083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:08.838538 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'fault' on Instance uuid 3034be98-8230-4ba1-bfd9-cb4e4cf776af {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:08.885019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:08.893039 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c47c86fb-b2f1-4a9d-a84a-4331de49eac7 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 200 len: 1332 microversion: 2.1 time: 0.139635 May 27 16:33:08.894114 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 344/694] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:08 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:09.055327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7a00e784-3f27-461c-8033-fe09b02615a8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/action" status: 202 len: 0 microversion: 2.1 time: 0.367948 May 27 16:33:09.055993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 351/695] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:33:08 2022] POST /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:33:09.075139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:09.075520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:09.083958 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:09.084342 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:09.085128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:09.085601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:09.271771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:09.283452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-aa126b99-b8cb-4901-a808-c57f35ad6ebc tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1723 microversion: 2.1 time: 0.222059 May 27 16:33:09.284044 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 345/696] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:09 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:09.911376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:09.912095 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:09.914090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=84 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:09.919723 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:09.920163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:09.920921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:09.921362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:09.936084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af HTTP/1.1 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:33:09.937309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:33:09.938871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '3034be98-8230-4ba1-bfd9-cb4e4cf776af'} May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:33:09.939770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:33:09.941255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:09.942854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:33:09.942854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-be540dd4-b82c-4db9-8bf6-cc050344cdb2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 404 len: 111 microversion: 2.1 time: 0.032037 May 27 16:33:09.942854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 352/697] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:09 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:33:09.948200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ef498da4-40eb-4d22-9e0f-cb0c56b5a36e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '.version_select at 0x7f0e99e70160>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:10.079612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ef498da4-40eb-4d22-9e0f-cb0c56b5a36e tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392127834" status: 202 len: 0 microversion: 2.1 time: 0.135279 May 27 16:33:10.080185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 346/698] 10.222.0.42 () {58 vars in 1220 bytes} [Fri May 27 16:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392127834 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:33:10.304645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:10.305321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:10.317044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:10.317560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:10.318522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:10.319144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:10.570328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:10.579809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-99e5e6e0-c3a3-4a14-a0b4-252dc8013f3a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1723 microversion: 2.1 time: 0.279563 May 27 16:33:10.580403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 353/699] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:10 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:10.960198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3664e7b7-a13a-4414-ac1b-740010ae44ca tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: .version_select at 0x7f0e99f12ca0>, body: {"keypair": {"name": "tempest-keypair-777127018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB9AgqU7qh5HxSJodrdPiGtye2f4FiuPiwJB6HfUqjPl4NK5/Vmm2J7qJfKQFDu4RDV4KpHIMwNFC8ZDxttFqm0yjG0QSMxnVeeQ09weyvxO/dFF5RhDuvmgxR9Lv/wgg=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:10.975281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-3664e7b7-a13a-4414-ac1b-740010ae44ca tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:10.979136 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-3664e7b7-a13a-4414-ac1b-740010ae44ca tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:10.993166 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:11.120197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3664e7b7-a13a-4414-ac1b-740010ae44ca tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163837 May 27 16:33:11.120802 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 347/700] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:33:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:11.596630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:11.597259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:11.603979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:11.604418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:11.605161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:11.605617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:11.770455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:11.779709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e4c9d1df-6062-4275-bb06-ecd54618eec2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1723 microversion: 2.1 time: 0.186840 May 27 16:33:11.780293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 354/701] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:11 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:12.798692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:12.800044 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:12.806191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:12.806642 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:12.807417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:12.807854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:12.957960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:12.966782 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-787dce01-f662-4486-9fe4-852c56bf0ca1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1729 microversion: 2.1 time: 0.173360 May 27 16:33:12.967354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 348/702] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:12 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:12.983585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:12.984129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:12.990561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:12.991009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:12.991763 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:12.992193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:13.096848 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8e8e4545-44a5-4391-bbd2-65839d1b73aa tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117199 May 27 16:33:13.097472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 355/703] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:33:12 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:33:14.106938 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-65e31026-7b1c-4c8d-976e-6bb85904fa5f req-4356e5cc-91fd-49bf-9aa1-5c1fb827fc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:14.115596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-65e31026-7b1c-4c8d-976e-6bb85904fa5f req-4356e5cc-91fd-49bf-9aa1-5c1fb827fc70 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:14.116347 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-65e31026-7b1c-4c8d-976e-6bb85904fa5f req-4356e5cc-91fd-49bf-9aa1-5c1fb827fc70 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:14.137205 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-65e31026-7b1c-4c8d-976e-6bb85904fa5f req-4356e5cc-91fd-49bf-9aa1-5c1fb827fc70 service nova] Creating event network-changed:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:33:14.143246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-65e31026-7b1c-4c8d-976e-6bb85904fa5f req-4356e5cc-91fd-49bf-9aa1-5c1fb827fc70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041919 May 27 16:33:14.144859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 349/704] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:14.545248 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1527190217", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6206a18c-fdfb-4556-905d-212faa509374"}], "security_groups": [{"name": "tempest-securitygroup--847301124"}], "key_name": "tempest-keypair-777127018", "user_data": "}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:14.723539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] validate_networks() for [('6206a18c-fdfb-4556-905d-212faa509374', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:33:15.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:33:15.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:33:15.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:33:15.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:33:15.263841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:33:15.271274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:15.271780 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:15.272712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:15.273255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:15.290187 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:15.295786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:15.307373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:33:15.310811 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:33:15.508289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5e74a149-1fd7-4a75-82e0-87ac77ec57fa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.968937 May 27 16:33:15.508846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 356/705] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:33:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:33:15.519988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-16c65916-8636-43ed-a42f-bf8ddc6175f0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:15.520674 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-16c65916-8636-43ed-a42f-bf8ddc6175f0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:15.584787 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-16c65916-8636-43ed-a42f-bf8ddc6175f0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:15.591486 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-16c65916-8636-43ed-a42f-bf8ddc6175f0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1241 microversion: 2.1 time: 0.075504 May 27 16:33:15.592313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 350/706] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:15 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:16.160194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-8ca44ea9-2555-4bce-bc9f-95dbc507b8bc req-3a396678-6759-4c02-8433-c7d1ce407521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:16.170481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8ca44ea9-2555-4bce-bc9f-95dbc507b8bc req-3a396678-6759-4c02-8433-c7d1ce407521 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:16.171035 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8ca44ea9-2555-4bce-bc9f-95dbc507b8bc req-3a396678-6759-4c02-8433-c7d1ce407521 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:16.182111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-8ca44ea9-2555-4bce-bc9f-95dbc507b8bc req-3a396678-6759-4c02-8433-c7d1ce407521 service nova] Creating event network-changed:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:33:16.187543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-8ca44ea9-2555-4bce-bc9f-95dbc507b8bc req-3a396678-6759-4c02-8433-c7d1ce407521 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 May 27 16:33:16.188120 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 357/707] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:33:16.612531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:16.613228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:16.623128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:16.623900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:16.624853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:16.625498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:16.700707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:16.708450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9db90c17-87f7-48ff-a38f-e226f5065cd0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1245 microversion: 2.1 time: 0.099682 May 27 16:33:16.709042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:16 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:17.726553 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:17.727460 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:17.735311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:17.735834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:17.736787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:17.737283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:17.804907 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:17.813210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e04784b0-00b2-4f2d-ae3d-37de0f018fff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1293 microversion: 2.1 time: 0.090785 May 27 16:33:17.814096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 358/709] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:17 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:18.388487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:18.389186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:18.397417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.401988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.401988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.401988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.431192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-946b833c-cd3d-488d-9b9c-f4dc8e67ad94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments/7e802274-1a3b-4ed4-a80e-f81c3471acdd" status: 200 len: 194 microversion: 2.20 time: 0.048073 May 27 16:33:18.438297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 352/710] 10.222.0.42 () {60 vars in 1453 bytes} [Fri May 27 16:33:18 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments/7e802274-1a3b-4ed4-a80e-f81c3471acdd => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:33:18.503406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:18.504148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:18.510293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.510732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.511487 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.511913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.759253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'services' on Instance uuid 491e3f1a-4810-4313-afad-ed811fb2bc9f {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:18.831115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:18.831756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:18.838006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.838680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.839541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:18.839985 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:18.860267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:18.914761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:18.922421 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-353f1d41-f6fe-4990-940e-6b83acf9e00f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1299 microversion: 2.1 time: 0.095214 May 27 16:33:18.922989 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 353/711] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:18 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:19.389260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0b090e3a-0b78-4a1e-84f4-bc5749b8ce51 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments/7e802274-1a3b-4ed4-a80e-f81c3471acdd" status: 202 len: 0 microversion: 2.20 time: 0.889633 May 27 16:33:19.389946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 359/712] 10.222.0.42 () {60 vars in 1456 bytes} [Fri May 27 16:33:18 2022] DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments/7e802274-1a3b-4ed4-a80e-f81c3471acdd => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 16:33:19.398888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:19.400748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:19.408895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:19.409367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:19.410214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:19.410650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:19.443867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a1aec446-26bf-4787-8a0f-a19456bd0b6f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049328 May 27 16:33:19.444451 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 354/713] 10.222.0.42 () {60 vars in 1342 bytes} [Fri May 27 16:33:19 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:33:19.941463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:19.950509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:19.950509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:19.950509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:19.950509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:19.951483 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:20.081660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:20.089168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b1a1204e-8818-4549-a46a-a41b88729f27 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.152393 May 27 16:33:20.099793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 360/714] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:19 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:20.456628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:20.458275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:20.468303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:20.468916 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:20.469774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:20.470301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:20.480761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-b881ec68-e66d-4ce0-b720-095d251d7c2c req-606b1442-c41c-4e86-9aef-5f12d649bd0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39837af-b086-4ba6-94cb-26c49dc4a2db", "tag": "666bdb61-6900-42a6-bc5b-209da3aaa34d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:20.492014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-b881ec68-e66d-4ce0-b720-095d251d7c2c req-606b1442-c41c-4e86-9aef-5f12d649bd0e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:20.492639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-b881ec68-e66d-4ce0-b720-095d251d7c2c req-606b1442-c41c-4e86-9aef-5f12d649bd0e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:20.505716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-b881ec68-e66d-4ce0-b720-095d251d7c2c req-606b1442-c41c-4e86-9aef-5f12d649bd0e service nova] Creating event network-changed:666bdb61-6900-42a6-bc5b-209da3aaa34d for instance f39837af-b086-4ba6-94cb-26c49dc4a2db on hv-cinder-84049 May 27 16:33:20.510868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-b881ec68-e66d-4ce0-b720-095d251d7c2c req-606b1442-c41c-4e86-9aef-5f12d649bd0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038509 May 27 16:33:20.511654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 361/715] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:33:20.521884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-564a7830-f216-4fb3-a39c-b38df7b82ae5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069284 May 27 16:33:20.522466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 355/716] 10.222.0.42 () {60 vars in 1342 bytes} [Fri May 27 16:33:20 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:33:21.107899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:21.108797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:21.115466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.115970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.116734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.117163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.258309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:21.267998 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-63c9f777-3103-4764-9ee0-594f1d7bc02c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.164841 May 27 16:33:21.270014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 362/717] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:21 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:21.533952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:21.534853 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:21.541799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.542243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.543001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.543957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.573828 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-10d56380-061c-41a7-8fd1-36c710ff9e4d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043730 May 27 16:33:21.574387 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 356/718] 10.222.0.42 () {60 vars in 1342 bytes} [Fri May 27 16:33:21 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:21.634826 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:21.635233 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:21.641501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.641941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.642714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:21.643121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:21.667559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:33:22.020786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4ce14850-6c0c-4328-b9a5-366101e38c09 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 204 len: 0 microversion: 2.20 time: 0.389551 May 27 16:33:22.021491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 363/719] 10.222.0.42 () {60 vars in 1279 bytes} [Fri May 27 16:33:21 2022] DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 16:33:22.030530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:22.031223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:22.037470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:22.037919 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:22.038678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:22.039112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:22.174547 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:22.182976 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:22.185090 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:22.186318 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f3f962f8-632c-4f31-afb0-2de6aaca5738 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.160463 May 27 16:33:22.186922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 357/720] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:22 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:22.292476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:22.294164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:22.300678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:22.301128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:22.301920 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:22.302363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:22.442477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:22.451009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-27dabe9f-bb8c-442f-ad88-15292ed9e62c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.161752 May 27 16:33:22.451543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 364/721] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:22 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:23.205833 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:23.206356 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:23.214089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:23.214548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:23.215322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:23.215762 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:23.360694 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:23.369949 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:23.371478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:23.373483 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ecdff70b-3623-41ac-9ff1-9b07a7c933bb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.172154 May 27 16:33:23.374052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 358/722] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:23 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:23.467468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:23.468113 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:23.474946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:23.475377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:23.476099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:23.476538 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:23.609973 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:23.618955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-50cba6e5-daab-468e-a7bc-b9031ecb82c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.155386 May 27 16:33:23.619598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 365/723] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:23 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:24.392462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:24.393169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:24.399717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:24.400253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:24.401072 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:24.401594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:24.549823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:24.558051 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:24.559553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:24.561447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f78124af-5835-44d8-bb4e-76b9074a8d38 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.172260 May 27 16:33:24.561996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 359/724] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:24 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:24.637013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:24.638012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:24.645047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:24.645619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:24.646465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:24.646968 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:24.796101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:24.798613 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.804462 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9b69b9c0-c01a-4eb7-9bd3-4d6f53903077 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.171449 May 27 16:33:24.805108 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:24 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:25.116295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:25.117634 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:25.125795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.126333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.127482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.128154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.432057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e2693694-9b7f-498b-b8e3-56da2dbc96ee tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action" status: 202 len: 0 microversion: 2.1 time: 0.319561 May 27 16:33:25.436515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 360/726] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:33:25 2022] POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:33:25.438951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:25.447569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=6 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:25.447569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:25.447569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:25.454712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.455799 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.456610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.457072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.586312 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:25.587657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:25.594174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:25.596556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.597249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.598374 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.599052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.621547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:25.633328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4d11ef0a-e8e6-40ee-919d-369b08db9af1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1754 microversion: 2.1 time: 0.195654 May 27 16:33:25.633917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:25 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:25.779986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:25.790744 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:25.792530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:25.793735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3750d44c-39ab-4c2b-a4af-9be579aadb59 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1722 microversion: 2.20 time: 0.217483 May 27 16:33:25.794297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 361/728] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:25 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:25.822522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:25.823135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:25.832639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.833089 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.833938 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:25.834533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:25.967190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:25.974719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-93389355-e9e1-4244-9b12-c8ef3730c027 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.156359 May 27 16:33:25.975303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:25 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:26.293631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-a414c2eb-756a-43bd-b84e-aafc4a4deecb req-593c6bc5-6482-4185-8e34-8f1b0d53a48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491e3f1a-4810-4313-afad-ed811fb2bc9f", "name": "network-vif-deleted", "tag": "8e5c90f6-77c3-4dde-aed5-80f7e3a77b80"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:26.304582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a414c2eb-756a-43bd-b84e-aafc4a4deecb req-593c6bc5-6482-4185-8e34-8f1b0d53a48c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.305281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a414c2eb-756a-43bd-b84e-aafc4a4deecb req-593c6bc5-6482-4185-8e34-8f1b0d53a48c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.319717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-a414c2eb-756a-43bd-b84e-aafc4a4deecb req-593c6bc5-6482-4185-8e34-8f1b0d53a48c service nova] Creating event network-vif-deleted:8e5c90f6-77c3-4dde-aed5-80f7e3a77b80 for instance 491e3f1a-4810-4313-afad-ed811fb2bc9f on hv-cinder-84049 May 27 16:33:26.326847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-a414c2eb-756a-43bd-b84e-aafc4a4deecb req-593c6bc5-6482-4185-8e34-8f1b0d53a48c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037732 May 27 16:33:26.328231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 362/730] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:26.719217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:26.720361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:26.726344 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.726785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.727547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.727977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.814052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:26.815278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:26.828868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.833040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.834712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.835312 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.883761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.884438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.885044 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'fault' on Instance uuid 491e3f1a-4810-4313-afad-ed811fb2bc9f {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:26.911237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:26.916928 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-81d4bd39-ea9f-4bad-b57a-691f6f0273e3 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1754 microversion: 2.1 time: 0.202968 May 27 16:33:26.917658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 369/731] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:26 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:26.923100 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-0fc7c008-aeed-4b45-b57e-2cb55d6d1654 req-5e0300e6-5935-416b-beb5-5b287a2c57ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39837af-b086-4ba6-94cb-26c49dc4a2db", "name": "network-vif-plugged", "status": "completed", "tag": "666bdb61-6900-42a6-bc5b-209da3aaa34d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:26.934679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0fc7c008-aeed-4b45-b57e-2cb55d6d1654 req-5e0300e6-5935-416b-beb5-5b287a2c57ff service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:26.935529 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0fc7c008-aeed-4b45-b57e-2cb55d6d1654 req-5e0300e6-5935-416b-beb5-5b287a2c57ff service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:26.951910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-0fc7c008-aeed-4b45-b57e-2cb55d6d1654 req-5e0300e6-5935-416b-beb5-5b287a2c57ff service nova] Creating event network-vif-plugged:666bdb61-6900-42a6-bc5b-209da3aaa34d for instance f39837af-b086-4ba6-94cb-26c49dc4a2db on hv-cinder-84049 May 27 16:33:26.957585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:26.962598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-0fc7c008-aeed-4b45-b57e-2cb55d6d1654 req-5e0300e6-5935-416b-beb5-5b287a2c57ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043028 May 27 16:33:26.963817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 370/732] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:26.966017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:26.967985 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:26.969171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-75f918bb-0db9-43d6-8069-0223f4575e44 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1369 microversion: 2.20 time: 0.160165 May 27 16:33:26.969763 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 363/733] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:26 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:26.992897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:26.993808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:27.002127 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.002714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:27.003630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.004098 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:27.177036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:27.207448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9991bc5a-1de8-4d73-aa65-9740ec7b89ac tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.218850 May 27 16:33:27.208039 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 371/734] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:26 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:27.936412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:27.937027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:27.943701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.944147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:27.946412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.946412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:27.988631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:27.989230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:27.995695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.996137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:27.997166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:27.997626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:28.031710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:28.032156 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:28.032616 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'fault' on Instance uuid 491e3f1a-4810-4313-afad-ed811fb2bc9f {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:28.089465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:28.098325 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:28.099969 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:28.101134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fde722ec-d351-461e-8522-871288d626b3 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 200 len: 1369 microversion: 2.20 time: 0.116321 May 27 16:33:28.102115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 372/735] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:27 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:28.127432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:28.135531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c8b1795f-d54d-4d3f-9b75-e270acc2da04 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.203331 May 27 16:33:28.136105 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 364/736] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:27 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:28.225734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:28.226257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:28.232302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:28.233278 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:28.234052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:28.234477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:28.367596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:28.376091 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e521cbb5-44cd-481e-aef4-49580200b438 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1366 microversion: 2.1 time: 0.154496 May 27 16:33:28.376662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 373/737] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:28 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:29.120491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:29.134043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:29.134043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.134043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.134043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.134466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.143780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f HTTP/1.1 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:33:29.145621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:33:29.147418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '491e3f1a-4810-4313-afad-ed811fb2bc9f'} May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:33:29.148521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:33:29.150303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:33:29.151908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:33:29.151908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-43c3d821-0bf9-4a4f-bc39-89d3d94aa9fc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 404 len: 111 microversion: 2.20 time: 0.030407 May 27 16:33:29.151908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 365/738] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:29 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:33:29.152310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:29.152929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:29.155470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-98b43361-f233-4060-8da7-ff653012ffd8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '.version_select at 0x7f0e99f65e50>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:29.160697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.161140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.161934 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.162363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.312422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:29.320758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-570130de-2e43-4ae4-a6ff-6ed41aa1da3f tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.172443 May 27 16:33:29.322010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 374/739] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:29 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:29.382664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-98b43361-f233-4060-8da7-ff653012ffd8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978792413" status: 204 len: 0 microversion: 2.20 time: 0.230657 May 27 16:33:29.383158 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 366/740] 10.222.0.42 () {60 vars in 1258 bytes} [Fri May 27 16:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978792413 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 16:33:29.393364 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:29.393992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:29.400701 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.401145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.402099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.402521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.535468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:29.543229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c8cc429a-e793-41ac-94aa-0063136a13d8 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1555 microversion: 2.1 time: 0.154422 May 27 16:33:29.543801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:29 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:29.559588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:29.560079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:29.566963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.567406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.568167 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:29.568601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:29.648638 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a26135eb-507b-49a4-bfd8-67446ff81a86 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092882 May 27 16:33:29.649241 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 367/742] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:33:29 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:30.339379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:30.340603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:30.348396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:30.348852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:30.349634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:30.350071 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:30.679249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-36b06d9b-9440-4445-9c63-efae496fde68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: .version_select at 0x7f0e9ab1d550>, body: {"keypair": {"name": "tempest-keypair-439619639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN79Aj2u5NPCXcN7v3sFpHjCvz89n5zxfpFoXd4bq3YsOFuIxl8XPhcseanx7vO8e0WzA+0gz3jgs3syr5Cnc1qOpbzHL9GFSEaVAtwDw59ybmPZHMTuYlNUi/POohjAw=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:30.695406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-36b06d9b-9440-4445-9c63-efae496fde68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for project 26ab6251a87c4271b77242545ef4837f. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:30.702860 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-36b06d9b-9440-4445-9c63-efae496fde68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for user 391d41dab9294cd39d3b80d60570034e and project 26ab6251a87c4271b77242545ef4837f. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:30.828705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:30.837257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-639bcecb-4dfd-4864-8e9d-d7b47041db67 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.501635 May 27 16:33:30.837841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 376/743] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:30 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:30.874397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-36b06d9b-9440-4445-9c63-efae496fde68 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.199656 May 27 16:33:30.875077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 368/744] 10.222.0.42 () {62 vars in 1199 bytes} [Fri May 27 16:33:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 27 16:33:31.094584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-5d9e30e3-2f32-454d-b910-7923bf211b3e req-5da4b5af-125c-4c82-a7f5-f03e050d9c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39837af-b086-4ba6-94cb-26c49dc4a2db", "tag": "666bdb61-6900-42a6-bc5b-209da3aaa34d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:31.103494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5d9e30e3-2f32-454d-b910-7923bf211b3e req-5da4b5af-125c-4c82-a7f5-f03e050d9c83 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:31.104228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5d9e30e3-2f32-454d-b910-7923bf211b3e req-5da4b5af-125c-4c82-a7f5-f03e050d9c83 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:31.118995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-5d9e30e3-2f32-454d-b910-7923bf211b3e req-5da4b5af-125c-4c82-a7f5-f03e050d9c83 service nova] Creating event network-changed:666bdb61-6900-42a6-bc5b-209da3aaa34d for instance f39837af-b086-4ba6-94cb-26c49dc4a2db on hv-cinder-84049 May 27 16:33:31.125241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-5d9e30e3-2f32-454d-b910-7923bf211b3e req-5da4b5af-125c-4c82-a7f5-f03e050d9c83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035263 May 27 16:33:31.126037 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 377/745] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:31.862329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:31.863140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:31.873767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:31.874378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:31.875272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:31.875959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:32.040645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:32.049555 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-edf43676-cc2c-4377-b5e3-4530e5788ec0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.196198 May 27 16:33:32.050211 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 369/746] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:31 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:33.068162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:33.068899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:33.075097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:33.075536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:33.076317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:33.076787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:33.220917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:33.229265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6f5a94b3-fefe-4901-8f8a-495837937f53 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.166273 May 27 16:33:33.229888 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 378/747] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:33 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:33.804084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1489988158", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55100481-4365-412d-b292-c811a999e4c5"}], "security_groups": [{"name": "tempest-securitygroup--36565421"}], "key_name": "tempest-keypair-439619639", "user_data": "}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:33.911415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] validate_networks() for [('55100481-4365-412d-b292-c811a999e4c5', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:33:34.248919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:34.249675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:34.256270 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:34.256652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:34.257455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:34.257911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:34.347790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:33:34.348216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:33:34.348712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:33:34.349102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:33:34.349556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:33:34.359107 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:34.359557 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:34.360351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:34.360787 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:34.378668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for project 26ab6251a87c4271b77242545ef4837f. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:34.382880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Getting quotas for user 391d41dab9294cd39d3b80d60570034e and project 26ab6251a87c4271b77242545ef4837f. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:34.394191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:33:34.396448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:33:34.422962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:34.431154 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8315356f-7fc7-4864-868c-eabfee4e0ae4 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.187040 May 27 16:33:34.431728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 379/748] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:34 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:34.510843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b48063df-5386-4c5a-b462-c44cfd72a1f8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.711129 May 27 16:33:34.511465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 370/749] 10.222.0.42 () {62 vars in 1187 bytes} [Fri May 27 16:33:33 2022] POST /compute/v2.1/servers => generated 400 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 16:33:34.522910 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:34.523619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:34.579035 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:34.588044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:34.589595 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:34.590727 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-820b6ce7-919c-4e26-998d-bc80dc11a10f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1281 microversion: 2.20 time: 0.071908 May 27 16:33:34.591289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 380/750] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:34 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:35.451489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:35.452034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:35.459784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:35.460262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:35.461029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:35.461500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:35.610297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:35.610941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:35.612549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:35.620961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0d6d4ff0-5773-4d29-9ecd-46830454a54b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.174025 May 27 16:33:35.621563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 371/751] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:35 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:35.665750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:35.675197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:35.676975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:35.677875 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fd63f5e6-25a9-4cb3-9354-845ce533eb80 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1281 microversion: 2.20 time: 0.072305 May 27 16:33:35.678426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 381/752] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:35 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:36.639034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:36.639676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:36.646537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:36.646987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:36.647749 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:36.648186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:36.696045 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:36.696649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:36.703951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:36.704463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:36.705245 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:36.705775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:36.790720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:36.799649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:36.801190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:36.802491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fc6672b1-3530-4b1d-8127-3685cc1f2413 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1333 microversion: 2.20 time: 0.110298 May 27 16:33:36.803128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 382/753] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:36 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:36.829183 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:36.837332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6abe18f2-bfc4-4fe5-860d-68830d3c73e6 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.202133 May 27 16:33:36.838025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 372/754] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:36 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:37.822003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:37.822614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:37.829687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:37.830041 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:37.830809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:37.831246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:37.855085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:37.855712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:37.871223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:37.872326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:37.874350 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:37.875176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:37.879828 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:38.063701 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:38.072708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:38.075288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:38.076665 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-246d8962-6001-41af-bf5a-32fb7c408bc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.258589 May 27 16:33:38.078738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 383/755] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:37 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:38.092619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:38.102469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-afd83011-c4aa-4593-8929-ec621ffbc2a7 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.251134 May 27 16:33:38.103451 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 373/756] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:37 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:38.870499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-e7ebf2cc-ead8-408d-b11e-530192c2073b req-491640a5-36a9-4080-ab4e-7e92cae9269b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:38.886801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-e7ebf2cc-ead8-408d-b11e-530192c2073b req-491640a5-36a9-4080-ab4e-7e92cae9269b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:38.912524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-e7ebf2cc-ead8-408d-b11e-530192c2073b req-491640a5-36a9-4080-ab4e-7e92cae9269b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:38.940152 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-e7ebf2cc-ead8-408d-b11e-530192c2073b req-491640a5-36a9-4080-ab4e-7e92cae9269b service nova] Creating event network-changed:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:33:38.958288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-e7ebf2cc-ead8-408d-b11e-530192c2073b req-491640a5-36a9-4080-ab4e-7e92cae9269b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079778 May 27 16:33:38.963202 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 384/757] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:39.100501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:39.101112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:39.108575 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:39.109029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:39.111015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:39.111461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:39.123253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:39.124771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:39.132110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:39.132813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:39.134009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:39.134598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:39.285123 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:39.294195 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:39.295988 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:39.298385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7ba42ace-9f87-4c9c-9eac-6cb460f908dd tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.200731 May 27 16:33:39.298971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 374/758] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:39 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:39.499823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:39.509836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-33207842-fb2b-4d81-aad2-1e0ef827b0ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.391015 May 27 16:33:39.510644 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 385/759] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:39 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:33:40.316713 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:40.317331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:40.324812 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:40.325276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:40.326077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:40.326511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:40.468770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:40.478215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:40.479799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:40.480964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b1b60d8e-a467-4ca4-b2a7-02f7929097fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.168448 May 27 16:33:40.481567 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 375/760] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:40 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:40.527916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:40.528544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:40.530948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:40.538426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:40.541090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:40.541090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:40.541090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:40.683192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:40.692013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-83c89916-d90f-4a90-8cb2-a6ed18108581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.167911 May 27 16:33:40.692520 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 386/761] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:40 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:41.499586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:41.500192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:41.506715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:41.507158 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:41.507922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:41.508354 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:41.646370 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:41.654847 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:41.656921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:41.658088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-cb5795ad-a3e7-4a34-8523-91ffe95df79f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.162662 May 27 16:33:41.658659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 376/762] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:41 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:41.709631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:41.710151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:41.717230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:41.717697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:41.718448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:41.718962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:41.721579 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:41.865147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:41.873553 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6ebb14f4-59a5-4959-91d3-36b506e27fa2 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.167948 May 27 16:33:41.874137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 387/763] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:41 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:42.016619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:42.017628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:42.023649 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.028731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.028731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.028731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.055628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7632f90-11d2-4b7d-83f8-b5c5f93f2987 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043044 May 27 16:33:42.056254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 377/764] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:33:42 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:33:42.116852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:42.117375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:42.123728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.124202 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.131104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.131104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.149384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:33:42.485116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-39481905-973d-41d2-8114-dea36cd08ce3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 204 len: 0 microversion: 2.1 time: 0.371696 May 27 16:33:42.485739 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 388/765] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:33:42 2022] DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:33:42.494237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:42.495055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:42.502501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.503043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.503719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.504157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.677018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:42.677860 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:42.684032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.684470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.685226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.685685 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.694839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:42.702462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8ed3f9c0-7cb3-4330-a6bf-a0a141c0855a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1673 microversion: 2.1 time: 0.212158 May 27 16:33:42.703240 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 378/766] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:42 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1673 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:42.817183 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:42.825064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:42.826614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:42.827719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c4b8a080-69ad-4057-ab70-41f7bef55ec2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.156013 May 27 16:33:42.831276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 389/767] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:42 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:42.891632 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:42.892259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:42.898420 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.898867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:42.899656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:42.900095 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:43.042805 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:43.053054 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9c203170-2779-4800-aa92-083e9d5aa4d9 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.165382 May 27 16:33:43.053685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 379/768] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:42 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:43.720636 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:43.721244 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:43.727878 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:43.728346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:43.729114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:43.729559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:43.850278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:43.851103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:43.859669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:43.860507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:43.861927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:43.862811 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:43.865956 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:43.874535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-af9a08d6-230e-4ec0-9eff-f8d4336a73cc tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1673 microversion: 2.1 time: 0.157858 May 27 16:33:43.875738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 390/769] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:43 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:44.011771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:44.019821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:44.021298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:44.022468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ce5da5be-2db7-4add-811c-999e44acf0d0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.176963 May 27 16:33:44.023028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 380/770] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:43 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:44.071439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:44.072036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:44.078050 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:44.078487 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:44.079422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:44.079852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:44.223582 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:44.231573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1a750a46-a5af-4b22-ab67-b18632cd6803 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.164071 May 27 16:33:44.232132 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 391/771] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:44 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:44.893551 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:44.894255 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:44.896192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:44.896856 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:44.898102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:44.902864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:44.903316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:44.916926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:44.916926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:45.042309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:45.043836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:45.052129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:45.052835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:45.053648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:45.054492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:45.056514 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:45.067619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-81adbde0-daee-4faf-a1fa-e8880f4c6ded tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1673 microversion: 2.1 time: 0.177079 May 27 16:33:45.068530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 381/772] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:44 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:45.190469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:45.198576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:45.200074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:45.201178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-eec66dbc-eff1-43de-80b4-8936b2affab7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.163855 May 27 16:33:45.201756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 392/773] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:45 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:33:45.252704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:45.262272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:45.262272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:45.262272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:45.262272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:45.262664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:45.421843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:45.431899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8ac49f46-54e7-4bfe-95b0-5b5e3df3d838 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1759 microversion: 2.1 time: 0.183501 May 27 16:33:45.432495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 382/774] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:45 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:46.086084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:46.086724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:46.088795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=4 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:46.097555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.097728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.099925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.100389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.114332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-a49a25a3-59da-41bb-aa4d-45121232afdc req-497b8185-74c0-461b-976a-1c2875b005e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5220d569-8535-429a-bfff-fa0955dec2c0", "name": "network-vif-deleted", "tag": "61d181d0-5525-4601-81ec-69cc30f5255c"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:46.134737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a49a25a3-59da-41bb-aa4d-45121232afdc req-497b8185-74c0-461b-976a-1c2875b005e3 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.135483 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a49a25a3-59da-41bb-aa4d-45121232afdc req-497b8185-74c0-461b-976a-1c2875b005e3 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.147786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-a49a25a3-59da-41bb-aa4d-45121232afdc req-497b8185-74c0-461b-976a-1c2875b005e3 service nova] Creating event network-vif-deleted:61d181d0-5525-4601-81ec-69cc30f5255c for instance 5220d569-8535-429a-bfff-fa0955dec2c0 on hv-cinder-84049 May 27 16:33:46.152998 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-a49a25a3-59da-41bb-aa4d-45121232afdc req-497b8185-74c0-461b-976a-1c2875b005e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043618 May 27 16:33:46.153797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 383/775] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:33:46.190828 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:46.209966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5383bd05-8684-426d-b9d9-35ac0992de1b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1606 microversion: 2.1 time: 0.124376 May 27 16:33:46.210987 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 393/776] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:46 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1606 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:46.220978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:46.221707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:46.228127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.228836 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.230013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.230311 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.383222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:46.393153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:46.395492 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:46.396176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-159687bd-db3d-47f6-ae9d-1494c9fcdb0b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.180019 May 27 16:33:46.396902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 384/777] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:46 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:46.450647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:46.451498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:46.459404 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.464720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.464720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:46.464720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:46.619543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:46.626652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c35f9bd9-08bd-4bb7-b6c0-448fa6a2bf28 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1762 microversion: 2.1 time: 0.180071 May 27 16:33:46.627255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 394/778] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:46 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1762 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:47.046074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-34fb8650-cf50-4f2e-b1ee-fb774a007e4a req-14558dff-c90e-495f-aa5b-4b06715329d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "name": "network-vif-plugged", "status": "completed", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:47.054989 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-34fb8650-cf50-4f2e-b1ee-fb774a007e4a req-14558dff-c90e-495f-aa5b-4b06715329d3 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.055433 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-34fb8650-cf50-4f2e-b1ee-fb774a007e4a req-14558dff-c90e-495f-aa5b-4b06715329d3 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.066581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-34fb8650-cf50-4f2e-b1ee-fb774a007e4a req-14558dff-c90e-495f-aa5b-4b06715329d3 service nova] Creating event network-vif-plugged:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:33:47.071480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-34fb8650-cf50-4f2e-b1ee-fb774a007e4a req-14558dff-c90e-495f-aa5b-4b06715329d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029509 May 27 16:33:47.072238 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 385/779] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:47.228782 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:47.229494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:47.237781 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.238732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.239076 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.239521 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.285798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.286243 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.286705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lazy-loading 'fault' on Instance uuid 5220d569-8535-429a-bfff-fa0955dec2c0 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:47.333628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:47.344740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7e22bcb5-9b89-4e9f-b2a2-194fe9dc2879 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 200 len: 1327 microversion: 2.1 time: 0.119072 May 27 16:33:47.345420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 395/780] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:47 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:47.416165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:47.416982 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:47.425696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.428322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.428322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:47.428322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:47.584937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:47.592926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:47.595324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:47.596445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7d9f55b-cf86-46b6-98a9-da8ab931acbb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.185140 May 27 16:33:47.597015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 386/781] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:47 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:48.363017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:48.363623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:48.370231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:48.370656 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:48.371415 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:48.371848 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:48.386077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 HTTP/1.1 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:33:48.387745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:33:48.389373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '5220d569-8535-429a-bfff-fa0955dec2c0'} May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:33:48.390348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:33:48.393199 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:33:48.394507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:33:48.394507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b652830b-a9ca-4bfb-b421-6da6974ab43c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 404 len: 111 microversion: 2.1 time: 0.030303 May 27 16:33:48.394507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 396/782] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:48 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:33:48.399044 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-53fb3e5a-2e16-4114-acce-4f4c5f019bab tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '.version_select at 0x7f0e9f0bfaf0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:48.498141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-53fb3e5a-2e16-4114-acce-4f4c5f019bab tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348895047" status: 202 len: 0 microversion: 2.1 time: 0.102379 May 27 16:33:48.498831 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 387/783] 10.222.0.42 () {58 vars in 1220 bytes} [Fri May 27 16:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348895047 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:33:48.616416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:48.617032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:48.623604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:48.624057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:48.624824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:48.626548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:48.767635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:48.776844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:48.778422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:48.779519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bd5fb753-ee87-4a6c-95b5-e75fd6787f98 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1405 microversion: 2.20 time: 0.167944 May 27 16:33:48.780069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 397/784] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:48 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:49.494939 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-95e8ae30-8bbe-44e1-9c9f-d14f5157d902 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: .version_select at 0x7f0e99ea7f70>, body: {"keypair": {"name": "tempest-keypair-66498741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBxgKeHmYu7Xsx+2QGF/PIuSHpf1A80cEPnkszIaY/xe8gQFO3MRv7GwOaiO5TDz6FdXAygXGxOSqLi+BSvb1Va0OwGBkikSyDj5RDJmMdmq3KREQR/lCGQWb2D3gQksA=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:49.511854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-95e8ae30-8bbe-44e1-9c9f-d14f5157d902 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:49.515790 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-95e8ae30-8bbe-44e1-9c9f-d14f5157d902 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for user 87d41932bfa94f369103ed29d29940b3 and project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:49.600973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-95e8ae30-8bbe-44e1-9c9f-d14f5157d902 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.110333 May 27 16:33:49.601630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 388/785] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:33:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:49.854718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:49.855373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:49.861564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:49.862011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:49.862815 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:49.863252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:50.006238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:50.014439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:50.016032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:50.017438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-edb683a1-2747-422c-be88-46534300d286 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1597 microversion: 2.20 time: 0.223694 May 27 16:33:50.018022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 398/786] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:33:49 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1597 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:33:50.039764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:50.040258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:50.046365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:50.046804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:50.048417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:50.048776 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:50.058456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:33:50.058631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:33:50.131769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ff2b7972-1dc6-4125-81ac-27fb9313946b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096090 May 27 16:33:50.132404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 389/787] 10.222.0.42 () {60 vars in 1315 bytes} [Fri May 27 16:33:50 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:33:51.398927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-3ae2db7a-2936-49c5-bc79-f46bbf2fd07e req-9a9d8ac5-417c-4079-a957-57959d879543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:51.411652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3ae2db7a-2936-49c5-bc79-f46bbf2fd07e req-9a9d8ac5-417c-4079-a957-57959d879543 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:51.412578 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3ae2db7a-2936-49c5-bc79-f46bbf2fd07e req-9a9d8ac5-417c-4079-a957-57959d879543 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:51.428473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-3ae2db7a-2936-49c5-bc79-f46bbf2fd07e req-9a9d8ac5-417c-4079-a957-57959d879543 service nova] Creating event network-changed:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:33:51.433694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-3ae2db7a-2936-49c5-bc79-f46bbf2fd07e req-9a9d8ac5-417c-4079-a957-57959d879543 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038703 May 27 16:33:51.434490 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 399/788] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:52.511480 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-678358386", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19f13b5c-dd0c-4771-8c9a-15d583cfbfcd"}], "security_groups": [{"name": "tempest-securitygroup--1896479167"}], "key_name": "tempest-keypair-66498741", "user_data": "}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:52.630439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] validate_networks() for [('19f13b5c-dd0c-4771-8c9a-15d583cfbfcd', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:33:53.067185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:33:53.067633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:33:53.068172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:33:53.068523 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:33:53.068928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:33:53.078707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:53.079156 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:53.079944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:53.080381 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:53.096878 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:33:53.101053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Getting quotas for user 87d41932bfa94f369103ed29d29940b3 and project 3fa953c1f6d240098f164785b8ccc5b4. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:33:53.112936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:33:53.115229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:33:53.310673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-06689ef5-3a30-417e-a1a8-00a722601e73 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.816896 May 27 16:33:53.311340 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 390/789] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:33:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:33:53.322740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b52a6746-b865-4cff-8329-83641f29b34c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:53.323387 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b52a6746-b865-4cff-8329-83641f29b34c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:53.380483 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b52a6746-b865-4cff-8329-83641f29b34c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:53.387608 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b52a6746-b865-4cff-8329-83641f29b34c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1235 microversion: 2.1 time: 0.069448 May 27 16:33:53.388206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 400/790] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:53 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:54.405770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:54.407111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:54.414294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:54.414746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:54.415519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:54.415967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:54.482503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:54.490394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e559a66e-def9-4532-9697-7acb0baeb7c4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1239 microversion: 2.1 time: 0.088703 May 27 16:33:54.490954 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 391/791] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:54 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:54.978193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:54.978785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:54.985419 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:54.985871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:54.992638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:54.992638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:55.072674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'services' on Instance uuid 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:33:55.410393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-24725d91-7cc9-4ac3-8667-ccb469c76c46 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments/6ab5ca23-a972-4eee-95d1-7b16c982c31f" status: 202 len: 0 microversion: 2.1 time: 0.436415 May 27 16:33:55.411906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 401/792] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:33:54 2022] DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments/6ab5ca23-a972-4eee-95d1-7b16c982c31f => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:33:55.419707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:55.420718 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:55.428825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:55.429288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:55.431066 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:55.431294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:55.461643 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c375690b-bf44-4c67-8662-1cdb708583d2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 May 27 16:33:55.462208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 392/793] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:33:55 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:55.564388 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:55.565159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:55.571509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:55.571960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:55.572725 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:55.573165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:55.643559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:55.652551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b8fdc1ac-9bdf-4f2b-9d9a-9df7fa159b53 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1295 microversion: 2.1 time: 0.148747 May 27 16:33:55.654018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 402/794] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:55 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1295 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:56.473758 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:56.474633 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:56.481526 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:56.481980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:56.482844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:56.483291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:56.516501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4670b79f-14b7-4cac-a01e-3817edd09df3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 May 27 16:33:56.520434 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 393/795] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:33:56 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:33:56.670523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:56.671173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:56.679396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:56.679839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:56.680602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:56.681065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:56.696348 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:56.744903 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:56.753146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-910520b2-9226-4a2b-a050-065d35e7fedd tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1293 microversion: 2.1 time: 0.086388 May 27 16:33:56.753745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 403/796] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:56 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:57.528512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:57.529470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:57.536686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.539754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.539754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.539754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.542292 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:57.570066 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-da5253bd-bba2-4c43-8f70-2827ff03dbdd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045650 May 27 16:33:57.570631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 394/797] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:33:57 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:33:57.654805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:57.655533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:57.667639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.668278 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.675026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.675642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.705836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:33:57.771055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:57.771670 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:57.778900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.779352 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.780136 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:57.780630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:57.931367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:57.940798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9074be6d-3b72-45d0-902e-94b7b97969ed tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.174218 May 27 16:33:57.941816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 395/798] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:57 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:58.058830 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-115eabb0-363a-4058-b874-e4bd1c758444 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 204 len: 0 microversion: 2.1 time: 0.408403 May 27 16:33:58.059896 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 404/799] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:33:57 2022] DELETE /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:33:58.177379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:58.178666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:58.185125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:58.185786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:58.186915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:58.187779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:58.214684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-8b177911-ba21-49b2-9b45-8127da70462d req-7de0b5d5-7331-4db3-9863-23075d018939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727a62b9-55e0-4e2d-b773-197b092299ca", "tag": "cc40eb88-ffe4-466d-8a3d-40058b281672"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:33:58.226268 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8b177911-ba21-49b2-9b45-8127da70462d req-7de0b5d5-7331-4db3-9863-23075d018939 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:58.226911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8b177911-ba21-49b2-9b45-8127da70462d req-7de0b5d5-7331-4db3-9863-23075d018939 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:58.253002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-8b177911-ba21-49b2-9b45-8127da70462d req-7de0b5d5-7331-4db3-9863-23075d018939 service nova] Creating event network-changed:cc40eb88-ffe4-466d-8a3d-40058b281672 for instance 727a62b9-55e0-4e2d-b773-197b092299ca on hv-cinder-84049 May 27 16:33:58.258611 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-8b177911-ba21-49b2-9b45-8127da70462d req-7de0b5d5-7331-4db3-9863-23075d018939 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048766 May 27 16:33:58.262757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 405/800] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:33:58.339201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:58.347867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f5c170cc-ed44-42d2-aace-d1523f435749 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1689 microversion: 2.1 time: 0.282757 May 27 16:33:58.348710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 396/801] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:58 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1689 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:58.959320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:58.960051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:58.966424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:58.966871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:58.967633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:58.968073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:59.102102 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:59.110926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c41a3a65-cef8-4f25-9714-0724254e1416 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.155177 May 27 16:33:59.111497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 406/802] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:58 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:33:59.366678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:33:59.367337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:33:59.374361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:59.374822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:59.375599 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:33:59.376149 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:33:59.518582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:33:59.526647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7cb494ce-7aea-4f6f-a7ad-b0e36f86c226 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1689 microversion: 2.1 time: 0.163813 May 27 16:33:59.527227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 397/803] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:33:59 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:00.127983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:00.128618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:00.135559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:00.136021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:00.136796 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:00.137234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:00.274143 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:00.282892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-abc83116-d806-4680-93aa-53944639d72a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.159549 May 27 16:34:00.283477 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 407/804] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:00 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:00.544132 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:00.544731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:00.552032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:00.552479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:00.553245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:00.553709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:00.682415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:00.690193 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b2cc775d-73bd-4153-9719-27820f82cf4c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1689 microversion: 2.1 time: 0.150054 May 27 16:34:00.690759 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 398/805] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:00 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:01.299735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:01.300357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:01.306835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:01.307276 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:01.308028 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:01.308458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:01.442942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:01.450327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8bd58b48-9744-4a12-b062-7b107aa87ed2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.154558 May 27 16:34:01.450881 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 408/806] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:01 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:01.707223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:01.707837 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:01.714384 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:01.714832 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:01.715605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:01.716040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:01.849249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:01.858242 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6be4b64a-0bca-4595-92f8-68538aff94d5 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1689 microversion: 2.1 time: 0.154877 May 27 16:34:01.858868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 399/807] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:01 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:02.468217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:02.468837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:02.476739 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:02.477188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:02.477987 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:02.478424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:02.617167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:02.625021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-485430a8-b6c8-4988-b1e4-dca013b10977 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.160722 May 27 16:34:02.625811 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 409/808] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:02 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:02.877278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:02.878130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:02.885163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:02.885644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:02.886416 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:02.886852 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:03.037980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:03.045645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b685e4d1-d007-4f5f-a484-6d42b3ac4180 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1689 microversion: 2.1 time: 0.173293 May 27 16:34:03.046222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 400/809] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:02 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:03.387256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:03.447164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-949a86e9-2f35-4b97-b0e3-4afe7cdbfcc5 req-c6f1021b-cf0e-459e-80f2-90145e615121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f", "name": "network-vif-deleted", "tag": "184d2fa2-c59f-4092-9f78-35e0ddf7631b"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:03.461904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-949a86e9-2f35-4b97-b0e3-4afe7cdbfcc5 req-c6f1021b-cf0e-459e-80f2-90145e615121 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:03.462375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-949a86e9-2f35-4b97-b0e3-4afe7cdbfcc5 req-c6f1021b-cf0e-459e-80f2-90145e615121 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:03.475923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-949a86e9-2f35-4b97-b0e3-4afe7cdbfcc5 req-c6f1021b-cf0e-459e-80f2-90145e615121 service nova] Creating event network-vif-deleted:184d2fa2-c59f-4092-9f78-35e0ddf7631b for instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f on hv-cinder-84049 May 27 16:34:03.482999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-949a86e9-2f35-4b97-b0e3-4afe7cdbfcc5 req-c6f1021b-cf0e-459e-80f2-90145e615121 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115118 May 27 16:34:03.483784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 410/810] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:03.643147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:03.643755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:03.645619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:03.646288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:03.657444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:03.657444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:03.657444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:03.657444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:03.809525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:03.817210 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5064b1a0-c5c5-4e19-bd9f-b111fb53bac8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.178135 May 27 16:34:03.817859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 401/811] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:03 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:04.064382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:04.065076 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:04.072165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:04.072533 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:04.073297 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:04.073759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:04.147825 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:04.163166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7b46e45d-7a80-4817-9f73-ff5f6bb6ced3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1621 microversion: 2.1 time: 0.100687 May 27 16:34:04.163166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 411/812] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:04 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:04.833692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:04.834316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:04.841446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:04.845777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:04.845777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:04.845777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:04.983581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:04.991897 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-57965b26-62de-4e21-9216-368ef6ad1d9f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.162126 May 27 16:34:04.992696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 402/813] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:04 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:05.179471 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:05.180012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:05.186375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:05.186818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:05.187573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:05.188237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:05.223612 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:05.224053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:05.224498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'fault' on Instance uuid 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:05.268315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:05.276904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4131acfc-5567-479b-b68d-8e55609ab77f tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 200 len: 1336 microversion: 2.1 time: 0.101564 May 27 16:34:05.277757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 412/814] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:05 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:06.009735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:06.010346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:06.016983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:06.017527 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:06.018299 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:06.018735 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:06.154900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:06.163150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c51d8ba4-cbfa-48d6-a56f-a41bd224615d tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.157190 May 27 16:34:06.163730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 403/815] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:06 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:06.293540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:06.294190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:06.301139 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:06.301626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:06.302392 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:06.302827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:06.316709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] HTTP exception thrown: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Request method failure captured: May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f HTTP/1.1 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxKnJ7-7LWepW6aA4PxHSDnHIjNyWGpXgH1-_edYrDmwcP9bdH7aKowr4kUdkSAX_jQmTs_X5pplHhTuQ4G43mr90Fk-w8GC-TOX1pCF3KDtCbKBjj7UM8tO2yntNq1ueoAF4tawQ7uDeXazOzw2c8K_YD2s9TfkMfOCsDx-4O1kgk May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:34:06.318486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6b6ae55c00cb4a43b8e2bc7df2ea9626", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: cf3e0adc32814585b57bf9f884840fc9 May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. May 27 16:34:06.320012 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f'} May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:06.320787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. May 27 16:34:06.322242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:06.323534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Returning 404 to user: Instance 2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:06.323534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ff81879d-b96f-42e2-a27e-6bffd7572cf7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f" status: 404 len: 111 microversion: 2.1 time: 0.030241 May 27 16:34:06.323534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 413/816] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:06 2022] GET /compute/v2.1/servers/2dfcb1f0-4f55-4aa0-9d83-1747c9900a2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:34:06.329201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0433cb21-2a81-4de3-aee8-75298b1cff2c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '.version_select at 0x7f0e9f0bfee0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:06.401158 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0433cb21-2a81-4de3-aee8-75298b1cff2c tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107511489" status: 202 len: 0 microversion: 2.1 time: 0.076284 May 27 16:34:06.401776 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 404/817] 10.222.0.42 () {58 vars in 1220 bytes} [Fri May 27 16:34:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107511489 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:34:07.181732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:07.182397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:07.189729 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:07.190173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:07.190936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:07.191370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:07.330962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:07.338893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-45af7e8c-93aa-400a-86b3-dca5888c8f3c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.160990 May 27 16:34:07.339473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 414/818] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:07 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:08.357582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:08.358184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:08.365115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:08.365590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:08.366353 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:08.366781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:08.500509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:08.508201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5ffda526-acaf-4a2f-a839-7aec56001066 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.154994 May 27 16:34:08.508781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 405/819] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:08 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:08.793308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-bda21877-c5d4-44f5-a947-8d2c7ea81291 req-3d8336b9-b01e-46fd-9b17-a8469b4d9a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727a62b9-55e0-4e2d-b773-197b092299ca", "name": "network-vif-plugged", "status": "completed", "tag": "cc40eb88-ffe4-466d-8a3d-40058b281672"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:08.803465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bda21877-c5d4-44f5-a947-8d2c7ea81291 req-3d8336b9-b01e-46fd-9b17-a8469b4d9a1e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:08.803944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bda21877-c5d4-44f5-a947-8d2c7ea81291 req-3d8336b9-b01e-46fd-9b17-a8469b4d9a1e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:08.816705 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-bda21877-c5d4-44f5-a947-8d2c7ea81291 req-3d8336b9-b01e-46fd-9b17-a8469b4d9a1e service nova] Creating event network-vif-plugged:cc40eb88-ffe4-466d-8a3d-40058b281672 for instance 727a62b9-55e0-4e2d-b773-197b092299ca on hv-cinder-84049 May 27 16:34:08.821743 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-bda21877-c5d4-44f5-a947-8d2c7ea81291 req-3d8336b9-b01e-46fd-9b17-a8469b4d9a1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032193 May 27 16:34:08.822359 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 415/820] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:09.529548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:09.529548 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:09.534673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:09.535205 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:09.536053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:09.536566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:09.676963 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:09.684385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e06fd205-c161-402c-b6da-cba06f21a0e9 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.162073 May 27 16:34:09.684965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 406/821] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:09 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:09.742626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:09.743200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:09.749873 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:09.751046 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:09.751822 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:09.752258 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:09.778618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:34:10.148634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-52c8090c-ffd2-44c1-8fda-12af576578c9 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 204 len: 0 microversion: 2.1 time: 0.409844 May 27 16:34:10.149300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 416/822] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:34:09 2022] DELETE /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:34:10.158059 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:10.158675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:10.165273 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:10.167795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:10.167795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:10.167795 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:10.301780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:10.309645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-603603c2-1c5c-4b13-a45b-2fcdc73617b2 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1506 microversion: 2.1 time: 0.156051 May 27 16:34:10.310229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 407/823] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:10 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:10.703228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:10.704576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:10.710638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:10.711085 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:10.711852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:10.712295 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:10.847890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:10.855460 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5bc8a583-4eb3-4a7e-8e62-87f337085396 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.156514 May 27 16:34:10.856026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 417/824] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:10 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:11.327630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:11.328204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:11.335584 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:11.336036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:11.336785 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:11.337218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:11.466956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:11.474582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0f2b7df9-74c8-43be-abc8-3fb0827ec8a7 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1506 microversion: 2.1 time: 0.150905 May 27 16:34:11.475160 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 408/825] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:11 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:11.872201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:11.873106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:11.876105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:11.880955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:11.881461 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:11.882225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:11.882654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:12.022049 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:12.029681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f0be5e4c-04c2-4c2a-a881-3466bcb0e5aa tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.161345 May 27 16:34:12.030282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 418/826] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:11 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:12.491357 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:12.491921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:12.498791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:12.499240 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:12.500000 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:12.500440 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:12.632435 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:12.640020 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-95e85800-f8d8-4197-8a46-b3cce82862ce tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1506 microversion: 2.1 time: 0.152579 May 27 16:34:12.640589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 409/827] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:12 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:13.047880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:13.050077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:13.055114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:13.055556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:13.056313 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:13.056745 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:13.059384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:13.190272 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:13.197986 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e9bf18e5-394a-4513-95ae-1e4ef1efb37c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1361 microversion: 2.1 time: 0.154367 May 27 16:34:13.198316 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 419/828] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:13 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:13.658645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:13.659251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:13.665919 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:13.666366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:13.667131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:13.667573 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:13.808171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:13.820279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5f9f1c8f-011e-4d96-ab80-4e990e691e79 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1506 microversion: 2.1 time: 0.166044 May 27 16:34:13.821228 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 410/829] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:13 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:14.215575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:14.216172 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:14.224928 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.225405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.226277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.226718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.315746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-5357ba3d-f10f-4066-ad6c-4d8c583975a0 req-4f83e587-6c7f-446f-9603-5c3e102dae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a376bd1-2163-4333-a7a2-978057e231c5", "name": "network-vif-deleted", "tag": "5e118c26-5265-4811-94b8-60efa598d923"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:14.325076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-5357ba3d-f10f-4066-ad6c-4d8c583975a0 req-4f83e587-6c7f-446f-9603-5c3e102dae3b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.325076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-5357ba3d-f10f-4066-ad6c-4d8c583975a0 req-4f83e587-6c7f-446f-9603-5c3e102dae3b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.337141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-5357ba3d-f10f-4066-ad6c-4d8c583975a0 req-4f83e587-6c7f-446f-9603-5c3e102dae3b service nova] Creating event network-vif-deleted:5e118c26-5265-4811-94b8-60efa598d923 for instance 8a376bd1-2163-4333-a7a2-978057e231c5 on hv-cinder-84049 May 27 16:34:14.342775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-5357ba3d-f10f-4066-ad6c-4d8c583975a0 req-4f83e587-6c7f-446f-9603-5c3e102dae3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 May 27 16:34:14.343663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 411/830] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:14.382602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:14.390967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-387da018-a20c-433b-b808-7d6f2f316926 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1547 microversion: 2.1 time: 0.179235 May 27 16:34:14.397750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 420/831] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:14 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:14.409014 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:14.409690 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:14.416084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.416550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.417330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.417925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.432933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:14.501254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8ac30c2d-afff-4305-a804-c50c664b3e7b tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097732 May 27 16:34:14.501892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 412/832] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:34:14 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:14.842546 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:14.843274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:14.851188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.851647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.852320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.852764 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.886481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:14.894420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:14.894420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'fault' on Instance uuid 8a376bd1-2163-4333-a7a2-978057e231c5 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:14.956444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:14.964081 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d366149e-3583-4ef8-89d2-8afa27abb0c1 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 200 len: 1311 microversion: 2.1 time: 0.127881 May 27 16:34:14.964687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 421/833] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:14 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:15.556410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-1bd41dda-fd70-4e77-beaf-0f3f909c05ce req-7bbc12e4-ef0f-4434-8b9c-c0dd667d2781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727a62b9-55e0-4e2d-b773-197b092299ca", "tag": "cc40eb88-ffe4-466d-8a3d-40058b281672"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:15.568846 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-1bd41dda-fd70-4e77-beaf-0f3f909c05ce req-7bbc12e4-ef0f-4434-8b9c-c0dd667d2781 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:15.569444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-1bd41dda-fd70-4e77-beaf-0f3f909c05ce req-7bbc12e4-ef0f-4434-8b9c-c0dd667d2781 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:15.582466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-1bd41dda-fd70-4e77-beaf-0f3f909c05ce req-7bbc12e4-ef0f-4434-8b9c-c0dd667d2781 service nova] Creating event network-changed:cc40eb88-ffe4-466d-8a3d-40058b281672 for instance 727a62b9-55e0-4e2d-b773-197b092299ca on hv-cinder-84049 May 27 16:34:15.587341 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-1bd41dda-fd70-4e77-beaf-0f3f909c05ce req-7bbc12e4-ef0f-4434-8b9c-c0dd667d2781 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 May 27 16:34:15.588327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 413/834] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:15.984549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:15.986058 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: 8a376bd1-2163-4333-a7a2-978057e231c5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:15.993585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:15.994292 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:15.995537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:15.995978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:15.999971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:16.001654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:16.009125 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.009843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.011011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.011603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.012388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] HTTP exception thrown: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Request method failure captured: May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 HTTP/1.1 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxKnJ7-7LWepW6aA4PxHSDnHIjNyWGpXgH1-_edYrDmwcP9bdH7aKowr4kUdkSAX_jQmTs_X5pplHhTuQ4G43mr90Fk-w8GC-TOX1pCF3KDtCbKBjj7UM8tO2yntNq1ueoAF4tawQ7uDeXazOzw2c8K_YD2s9TfkMfOCsDx-4O1kgk May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:34:16.014368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6b6ae55c00cb4a43b8e2bc7df2ea9626", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: cf3e0adc32814585b57bf9f884840fc9 May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. May 27 16:34:16.015957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '8a376bd1-2163-4333-a7a2-978057e231c5'} May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:16.017291 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. May 27 16:34:16.018612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:16.019686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Returning 404 to user: Instance 8a376bd1-2163-4333-a7a2-978057e231c5 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:16.019686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-29bfd3d9-64d6-435a-8bf7-66fe615a6f2e tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5" status: 404 len: 111 microversion: 2.1 time: 0.036999 May 27 16:34:16.021884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 414/835] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:15 2022] GET /compute/v2.1/servers/8a376bd1-2163-4333-a7a2-978057e231c5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:34:16.027015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:16.027593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:16.034650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.035433 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.036574 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.037308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.052197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-249a8f4e-7fbe-42b2-b0ee-4acd2d6809ff tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/ips" status: 200 len: 149 microversion: 2.1 time: 0.185886 May 27 16:34:16.068883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 422/836] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:34:15 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/ips => generated 149 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:16.069254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:34:16.303734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:16.395758 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a5473d2a-fd7d-4e0b-adf1-4e9a668d5e0a tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 204 len: 0 microversion: 2.1 time: 0.372520 May 27 16:34:16.396338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 415/837] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:34:16 2022] DELETE /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:34:16.404342 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:16.405611 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:16.411264 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.411700 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.412447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:16.412878 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:16.557790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:16.573575 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2347f888-7ca3-4dd9-a5d5-e1f0ea1182e8 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.172906 May 27 16:34:16.574450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 423/838] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:16 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:17.593173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:17.593899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:17.602307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:17.602760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:17.603543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:17.604013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:17.702044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad1666bb-2f38-404a-a2e1-8d3390f990e3"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:17.703168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:17.710839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:17.711433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:17.712046 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:17.712472 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:17.753183 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:17.760964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8a9db38a-08e1-4ca7-b5bb-3dfe4328c2cd tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.172432 May 27 16:34:17.761861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 416/839] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:17 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:18.778617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:18.779304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:18.786750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:18.790027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:18.790027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:18.790027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:19.142760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:19.150816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a36d7e58-55d6-4866-8eee-1df693dc3ce0 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.376057 May 27 16:34:19.151399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 417/840] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:18 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:20.168733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:20.169447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:20.176007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:20.176452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:20.177214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:20.177676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:20.316450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:20.323844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-50fb26fa-3bbd-46c6-bd0e-068f19ba8316 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1519 microversion: 2.1 time: 0.158986 May 27 16:34:20.324405 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 418/841] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:20 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:20.701226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f2eebf9d-d7da-4c03-857a-c5e93c444045 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.002958 May 27 16:34:20.706835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 424/842] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:34:17 2022] POST /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments => generated 194 bytes in 3005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:20.933603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-dc6ef475-c895-4f55-909c-891eaa85a746 req-34e66785-7fc0-45b2-8dab-d68f3c5835a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc97e34-9888-4c3d-9ea1-226e97c009c9", "name": "network-vif-deleted", "tag": "8f129cf8-d17c-49bd-bb15-e74ecf6db21d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:20.942261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-dc6ef475-c895-4f55-909c-891eaa85a746 req-34e66785-7fc0-45b2-8dab-d68f3c5835a2 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:20.942710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-dc6ef475-c895-4f55-909c-891eaa85a746 req-34e66785-7fc0-45b2-8dab-d68f3c5835a2 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:20.954198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-dc6ef475-c895-4f55-909c-891eaa85a746 req-34e66785-7fc0-45b2-8dab-d68f3c5835a2 service nova] Creating event network-vif-deleted:8f129cf8-d17c-49bd-bb15-e74ecf6db21d for instance edc97e34-9888-4c3d-9ea1-226e97c009c9 on hv-cinder-84049 May 27 16:34:20.959808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-dc6ef475-c895-4f55-909c-891eaa85a746 req-34e66785-7fc0-45b2-8dab-d68f3c5835a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029903 May 27 16:34:20.960469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 419/843] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:21.342112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:21.342827 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:21.350196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:21.350830 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:21.351607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:21.352242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:21.384466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:21.384922 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:21.385405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lazy-loading 'fault' on Instance uuid edc97e34-9888-4c3d-9ea1-226e97c009c9 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:21.429450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e0adc32814585b57bf9f884840fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6ae55c00cb4a43b8e2bc7df2ea9626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:21.437072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3dd09e7e-36d9-4621-a206-681f519ba5c3 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 200 len: 1311 microversion: 2.1 time: 0.099753 May 27 16:34:21.437686 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 425/844] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:21 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:22.455282 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:22.455878 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] [instance: edc97e34-9888-4c3d-9ea1-226e97c009c9] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:22.462184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:22.462630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:22.463384 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:22.463818 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:22.477478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] HTTP exception thrown: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Request method failure captured: May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 HTTP/1.1 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxKnJ7-7LWepW6aA4PxHSDnHIjNyWGpXgH1-_edYrDmwcP9bdH7aKowr4kUdkSAX_jQmTs_X5pplHhTuQ4G43mr90Fk-w8GC-TOX1pCF3KDtCbKBjj7UM8tO2yntNq1ueoAF4tawQ7uDeXazOzw2c8K_YD2s9TfkMfOCsDx-4O1kgk May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:34:22.479076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6b6ae55c00cb4a43b8e2bc7df2ea9626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6b6ae55c00cb4a43b8e2bc7df2ea9626", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 6b6ae55c00cb4a43b8e2bc7df2ea9626 May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-304175502 May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: cf3e0adc32814585b57bf9f884840fc9 May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-304175502-project May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. May 27 16:34:22.480646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'edc97e34-9888-4c3d-9ea1-226e97c009c9'} May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:22.481520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. May 27 16:34:22.482900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:22.484169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] Returning 404 to user: Instance edc97e34-9888-4c3d-9ea1-226e97c009c9 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:22.484169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f650e3b1-3a33-4140-919b-ebf6143ed497 tempest-ServerRescueNegativeTestJSON-304175502 tempest-ServerRescueNegativeTestJSON-304175502-project] 10.222.0.42 "GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9" status: 404 len: 111 microversion: 2.1 time: 0.030341 May 27 16:34:22.484169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 420/845] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:22 2022] GET /compute/v2.1/servers/edc97e34-9888-4c3d-9ea1-226e97c009c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:34:29.297645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad1666bb-2f38-404a-a2e1-8d3390f990e3"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:29.301171 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:29.306935 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.307389 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.308158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.308598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.390951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: POST /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments HTTP/1.1 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 74 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:34:29.395726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {"volumeAttachment": {"volumeId": "ad1666bb-2f38-404a-a2e1-8d3390f990e3"}} May 27 16:34:29.397391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'server_id': 'f39837af-b086-4ba6-94cb-26c49dc4a2db', 'body': {'volumeAttachment': {'volumeId': 'ad1666bb-2f38-404a-a2e1-8d3390f990e3'}}} May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:29.398824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:29.399991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 400 to user: Invalid volume: volume ad1666bb-2f38-404a-a2e1-8d3390f990e3 is already attached to instances: f39837af-b086-4ba6-94cb-26c49dc4a2db {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d4e1a798-db48-4aa7-99ba-19b422ebff74 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103650 May 27 16:34:29.401185 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 426/846] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:34:29 2022] POST /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 16:34:29.459630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:29.460198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:29.466841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.467303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.468065 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.468502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.554062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'services' on Instance uuid f39837af-b086-4ba6-94cb-26c49dc4a2db {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:29.811733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-293bc840-92a4-4efe-a5e1-580b3d3be138 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments/ad1666bb-2f38-404a-a2e1-8d3390f990e3" status: 202 len: 0 microversion: 2.1 time: 0.356142 May 27 16:34:29.816109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 421/847] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:34:29 2022] DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments/ad1666bb-2f38-404a-a2e1-8d3390f990e3 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:34:29.821872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:29.822879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:29.829201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.829683 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.830514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:29.831091 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:29.863273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-eb1162b4-c778-458f-be11-2cb9e93c2b47 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 May 27 16:34:29.863838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 427/848] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:29 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:30.013957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1205888245"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:30.019172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:30.030419 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:30.030869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:30.031887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:30.032329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:30.170239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.network.security_group_api [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Removing security group 6a447d1f-dc4a-436e-b6a0-b6f2fa069b6c from port 3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d May 27 16:34:30.855519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b4ef616a-417f-4f59-bcd1-2cef55413410 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action" status: 202 len: 0 microversion: 2.1 time: 0.839390 May 27 16:34:30.855519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 422/849] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:34:30 2022] POST /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:34:30.880252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:30.881610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:30.892783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:30.895629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:30.896672 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:30.897899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:30.976381 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e04aac59-1a6c-46f0-9a81-be04fea5f9fe tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101323 May 27 16:34:30.978496 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 423/850] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:30 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:31.213160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-8d8b2d1f-6bcc-4524-ab57-a39b382846bd req-7bca5baf-8786-4f4e-b291-b2aa98a2c0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:31.230729 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8d8b2d1f-6bcc-4524-ab57-a39b382846bd req-7bca5baf-8786-4f4e-b291-b2aa98a2c0be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:31.231379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8d8b2d1f-6bcc-4524-ab57-a39b382846bd req-7bca5baf-8786-4f4e-b291-b2aa98a2c0be service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:31.245761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-8d8b2d1f-6bcc-4524-ab57-a39b382846bd req-7bca5baf-8786-4f4e-b291-b2aa98a2c0be service nova] Creating event network-changed:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:34:31.251378 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-8d8b2d1f-6bcc-4524-ab57-a39b382846bd req-7bca5baf-8786-4f4e-b291-b2aa98a2c0be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388648 May 27 16:34:31.253740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 428/851] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:31.998479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:31.999898 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:32.008507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.009970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.010809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.011245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.041819 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-745400b2-4374-47bb-9c34-03b435013dab tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050233 May 27 16:34:32.042388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 424/852] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:31 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 16:34:32.120763 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:32.120763 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:32.123675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.124131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.124924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.125372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.155343 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:34:32.446627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a0fdf72b-d415-4cb1-9bb4-c7a3d16c65c6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 204 len: 0 microversion: 2.1 time: 0.336363 May 27 16:34:32.447319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 429/853] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:34:32 2022] DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:34:32.458184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:32.459276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:32.469931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.470889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.473094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.473962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.636397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:32.645559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-286f42dd-218b-46b3-a4fc-062abe2e05cb tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1680 microversion: 2.1 time: 0.193815 May 27 16:34:32.646157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 425/854] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:32 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:32.748692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:32.749271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:32.760905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-88788817-14ca-4cb1-a371-25f79e3445ba req-f16bc7d0-ea1d-4895-8598-3dee3f932131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:32.768121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.770095 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-88788817-14ca-4cb1-a371-25f79e3445ba req-f16bc7d0-ea1d-4895-8598-3dee3f932131 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.770458 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.770573 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-88788817-14ca-4cb1-a371-25f79e3445ba req-f16bc7d0-ea1d-4895-8598-3dee3f932131 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.772194 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:32.773438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:32.786298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-88788817-14ca-4cb1-a371-25f79e3445ba req-f16bc7d0-ea1d-4895-8598-3dee3f932131 service nova] Creating event network-changed:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:34:32.791563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-88788817-14ca-4cb1-a371-25f79e3445ba req-f16bc7d0-ea1d-4895-8598-3dee3f932131 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 May 27 16:34:32.792365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 426/855] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:32.872405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lazy-loading 'services' on Instance uuid 43f50a3d-9ef6-49a8-9647-b7aa583caab7 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:33.096539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8e2515aa-fa46-4a1d-a273-2e85d55d7a99 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments/1bce785d-d439-4226-8be1-a003c9ff658a" status: 202 len: 0 microversion: 2.1 time: 0.352375 May 27 16:34:33.097761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 430/856] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:34:32 2022] DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments/1bce785d-d439-4226-8be1-a003c9ff658a => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:34:33.110745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:33.112999 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:33.119687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:33.120116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:33.121073 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:33.121598 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:33.159214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3afe7053-8bdd-4e62-ba17-a6f3a939dedb tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056777 May 27 16:34:33.159799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 427/857] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:33 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:33.665152 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:33.666619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:33.675520 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:33.676135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:33.677251 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:33.677885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:33.816334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:33.824781 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d796ab36-0a67-4ca3-ba76-d1eeb28c151b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1680 microversion: 2.1 time: 0.165343 May 27 16:34:33.825380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 431/858] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:33 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:34.172424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:34.173611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:34.181062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.182283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.192287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.192287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.216448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-301bf5fe-269e-4f9c-ae6f-eee55884a3c0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 May 27 16:34:34.217041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 428/859] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:34 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:34.842786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:34.843390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:34.843607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:34.844429 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:34.851231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.851606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.852057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.852358 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.852986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.853450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.854327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:34.854848 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:34.889015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:34.895774 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6c406bc6-9d60-400b-bc1e-a8de299ef45c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/ips" status: 200 len: 152 microversion: 2.20 time: 0.057015 May 27 16:34:34.896406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 432/860] 10.222.0.42 () {60 vars in 1288 bytes} [Fri May 27 16:34:34 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/ips => generated 152 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:34:35.147753 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:35.155550 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6b16fa2e-b5fe-4fb8-8449-d2d211ce71bf tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1680 microversion: 2.1 time: 0.316262 May 27 16:34:35.156218 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 429/861] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:34 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1680 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:35.229627 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:35.230687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:35.239570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:35.240104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:35.240943 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:35.241497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:35.271752 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5958794c-11c7-476f-a38a-de3c07bd5333 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 May 27 16:34:35.272240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 433/862] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:35 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:35.947035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-d3f118d7-bbbb-4aaf-92c1-534846b6e685 req-68f5f087-db65-48f9-b056-630687bcab3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39837af-b086-4ba6-94cb-26c49dc4a2db", "name": "network-vif-deleted", "tag": "666bdb61-6900-42a6-bc5b-209da3aaa34d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:35.957874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-d3f118d7-bbbb-4aaf-92c1-534846b6e685 req-68f5f087-db65-48f9-b056-630687bcab3e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:35.958429 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-d3f118d7-bbbb-4aaf-92c1-534846b6e685 req-68f5f087-db65-48f9-b056-630687bcab3e service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:35.970330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-d3f118d7-bbbb-4aaf-92c1-534846b6e685 req-68f5f087-db65-48f9-b056-630687bcab3e service nova] Creating event network-vif-deleted:666bdb61-6900-42a6-bc5b-209da3aaa34d for instance f39837af-b086-4ba6-94cb-26c49dc4a2db on hv-cinder-84049 May 27 16:34:35.975559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-d3f118d7-bbbb-4aaf-92c1-534846b6e685 req-68f5f087-db65-48f9-b056-630687bcab3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 May 27 16:34:35.976410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 430/863] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:36.172823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:36.174336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:36.182361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.182812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.183576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.184002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.256265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:36.263810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cc1eeb4a-4c6e-419a-906c-a6208abe25d9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1613 microversion: 2.1 time: 0.095208 May 27 16:34:36.267504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 434/864] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:36 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:36.283645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:36.285675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:36.292061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.292511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.293275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.293746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.309146 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:36.326301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bd5e8891-42f5-4c49-9b8b-e58644597c61 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046921 May 27 16:34:36.327128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 431/865] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:34:36 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:34:36.338844 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:36.339911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:36.347831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.350388 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.350388 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:36.350388 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:36.435655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] HTTP exception thrown: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 is not attached to volume 1bce785d-d439-4226-8be1-a003c9ff658a May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Request method failure captured: May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments/1bce785d-d439-4226-8be1-a003c9ff658a HTTP/1.1 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPzTZ4xq23hktyD2HU5cvtjinQ5MKQHQslLtTsvvkU-W7Cnt2be8Jk2FeqhQroVzKpMxuop3M4S39Onsx9Iqu1osuo6E5aNBexeWd1jIu4yuhbKt_ZFn-f8HEjmxx44OOmzaCyj-0lFlYv6H4F9_RE9VrIxqDNlFE3O2vQ4-OkAKS2o May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: bf8f192a31204d97b3b2e8895856a459 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:34:36.449923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf8f192a31204d97b3b2e8895856a459", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: bf8f192a31204d97b3b2e8895856a459 May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-TestMinimumBasicScenario-759095978-project May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 650592005e10426b95a76ebd97b07455 May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-TestMinimumBasicScenario-759095978-project May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:34:36.451596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 is not attached to volume 1bce785d-d439-4226-8be1-a003c9ff658a May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'server_id': '43f50a3d-9ef6-49a8-9647-b7aa583caab7', 'id': '1bce785d-d439-4226-8be1-a003c9ff658a'} May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1bce785d-d439-4226-8be1-a003c9ff658a. May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:36.452445 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 is not attached to volume 1bce785d-d439-4226-8be1-a003c9ff658a May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 is not attached to volume 1bce785d-d439-4226-8be1-a003c9ff658a May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:34:36.453892 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Returning 404 to user: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 is not attached to volume 1bce785d-d439-4226-8be1-a003c9ff658a {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:36.455064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-db9ad847-9621-4fe3-ad63-2d86e83577b1 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments/1bce785d-d439-4226-8be1-a003c9ff658a" status: 404 len: 154 microversion: 2.1 time: 0.118038 May 27 16:34:36.455382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 435/866] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:34:36 2022] DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7/os-volume_attachments/1bce785d-d439-4226-8be1-a003c9ff658a => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:34:37.179286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:37.179898 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:37.186608 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.187089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.187865 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.188293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.213951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'flavor' on Instance uuid 78b0b84c-8f9d-442f-a24d-250c3596bd37 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:37.287846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:37.288576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:37.298168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.298982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.301180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.302523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.340578 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.341019 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.341492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'fault' on Instance uuid f39837af-b086-4ba6-94cb-26c49dc4a2db {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:37.426405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:37.434259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dce53f31-2f74-45f3-adda-cb350c884c45 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 200 len: 1331 microversion: 2.1 time: 0.151048 May 27 16:34:37.434848 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 436/867] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:37 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 1331 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:37.865190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:37.865717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:37.873788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.874240 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.875057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:37.875498 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:37.902516 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:34:38.188002 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-10dead86-89a7-43d5-9a96-a85cdea32fc2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/action" status: 202 len: 0 microversion: 2.20 time: 1.013293 May 27 16:34:38.188715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 432/868] 10.222.0.42 () {62 vars in 1318 bytes} [Fri May 27 16:34:37 2022] POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/action => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 16:34:38.197617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:38.198388 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:38.204618 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.205061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.206973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.206973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.345463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:38.349398 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bf00ba25-4b42-4ee4-936f-1290f64d60bd tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 204 len: 0 microversion: 2.1 time: 0.488178 May 27 16:34:38.349989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 437/869] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:34:37 2022] DELETE /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 16:34:38.358847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:38.359829 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:38.361307 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:38.363488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:38.365008 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c9a5a53b-3fb9-44e9-accc-e08c4853fdbe tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.171276 May 27 16:34:38.365733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 433/870] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:38 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:38.378207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.378207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.379307 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.379753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.452305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:38.453259 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:38.461017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.461512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.462300 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:38.462743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:38.481514 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db HTTP/1.1 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:34:38.483175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:34:38.484541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'f39837af-b086-4ba6-94cb-26c49dc4a2db'} May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:38.485316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:34:38.486701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:38.488248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:38.488248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b12db7be-18d4-4245-b7ca-e72ed2753c7c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 404 len: 111 microversion: 2.1 time: 0.036281 May 27 16:34:38.488248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 434/871] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:38 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:34:38.494086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-326472e6-9689-433c-937d-35935666bcfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '.version_select at 0x7f0e99f129d0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:38.537314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:38.545060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-47f0136b-d3cd-481d-8f88-84060d86e489 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1556 microversion: 2.1 time: 0.190510 May 27 16:34:38.545758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 438/872] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:38 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:38.595594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-326472e6-9689-433c-937d-35935666bcfd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777127018" status: 202 len: 0 microversion: 2.1 time: 0.105198 May 27 16:34:38.596251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 435/873] 10.222.0.42 () {58 vars in 1217 bytes} [Fri May 27 16:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777127018 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:34:39.384151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:39.384726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:39.391355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:39.391880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:39.392646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:39.393145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:39.499236 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-310dcede-4d4e-4278-88bf-e9043ca222d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: .version_select at 0x7f0e9efef550>, body: {"keypair": {"name": "tempest-keypair-1322657184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKePuCwlgumJD1Cykcq49RsXx/V668NNrfatetmc4fiGjsU8hlyv7fGHl7OHycHdvBe9ETzFs2gwj0D5+w9IJghSUtU+KsV64zpPbnEdCdnyKASoTPKp5PW5ZJbMmnjFRQ=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:39.518578 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-310dcede-4d4e-4278-88bf-e9043ca222d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:34:39.525485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-310dcede-4d4e-4278-88bf-e9043ca222d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:34:39.553223 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:39.561230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:39.562785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:39.565906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8da55a37-032d-4ee2-8247-b28ae870c461 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.183854 May 27 16:34:39.565906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 439/874] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:39 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:39.569834 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:39.570461 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:39.576416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:39.576862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:39.577635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:39.578069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:39.618809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-310dcede-4d4e-4278-88bf-e9043ca222d2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126915 May 27 16:34:39.618809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 436/875] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:34:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:39.721300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:39.729437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dda34ed9-276c-4433-9491-6dd203ee8581 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1556 microversion: 2.1 time: 0.163819 May 27 16:34:39.730090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 440/876] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:39 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:40.585021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:40.586016 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:40.594203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:40.594729 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:40.595776 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:40.596279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:40.750182 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:40.753274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:40.764896 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:40.765377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:40.766269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:40.766880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:40.772470 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:40.781872 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:40.783366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:40.785401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e6bec6c9-a879-4099-afa8-ed9b99452c15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.205503 May 27 16:34:40.786402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 437/877] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:40 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:40.945950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:40.957556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e14ea1b7-c007-4912-bbeb-c14408e9c26b tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1556 microversion: 2.1 time: 0.213951 May 27 16:34:40.958137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 441/878] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:40 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:41.214416 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-aa903303-4bb5-46d3-affb-947f442ac605 req-7b91b78c-8059-4471-a77b-11d6aeff2865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f50a3d-9ef6-49a8-9647-b7aa583caab7", "name": "network-vif-deleted", "tag": "3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:41.227541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-aa903303-4bb5-46d3-affb-947f442ac605 req-7b91b78c-8059-4471-a77b-11d6aeff2865 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:41.227993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-aa903303-4bb5-46d3-affb-947f442ac605 req-7b91b78c-8059-4471-a77b-11d6aeff2865 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:41.241672 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-aa903303-4bb5-46d3-affb-947f442ac605 req-7b91b78c-8059-4471-a77b-11d6aeff2865 service nova] Creating event network-vif-deleted:3d4f9346-07d9-4daf-b9c3-f76f7e6ce78d for instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 on hv-cinder-84049 May 27 16:34:41.255343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-aa903303-4bb5-46d3-affb-947f442ac605 req-7b91b78c-8059-4471-a77b-11d6aeff2865 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044691 May 27 16:34:41.256283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 438/879] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:41.803731 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:41.804355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:41.811065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:41.811526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:41.812337 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:41.812775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:41.962186 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:41.971162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:41.974523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:41.979185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:41.979887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:41.986351 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:41.986788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:41.987889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:41.988654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:41.990261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4484cffc-0267-436d-b216-3b254e463d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.190319 May 27 16:34:41.992480 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 442/880] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:41 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:42.031295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:42.032113 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:42.032726 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lazy-loading 'fault' on Instance uuid 43f50a3d-9ef6-49a8-9647-b7aa583caab7 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:34:42.076646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650592005e10426b95a76ebd97b07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f192a31204d97b3b2e8895856a459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:42.085197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5045102c-a556-4d02-9ee9-8aef833daf12 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 200 len: 1349 microversion: 2.1 time: 0.113100 May 27 16:34:42.086258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 439/881] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:41 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 1349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:42.420029 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1545579148", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6206a18c-fdfb-4556-905d-212faa509374"}], "security_groups": [{"name": "tempest-securitygroup--1809421958"}], "key_name": "tempest-keypair-1322657184", "user_data": "}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:42.427490 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:42.536669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] validate_networks() for [('6206a18c-fdfb-4556-905d-212faa509374', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:34:43.010231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:43.010797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:43.017525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.019338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.020219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.020827 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.042972 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:34:43.043982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:34:43.044701 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:34:43.047386 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:34:43.048090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:34:43.059829 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.060454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.061039 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.061522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.079911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:34:43.085492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Getting quotas for user 56799d191ffe4193918fa0221c27c0e0 and project c409475791e243108336a3cd2e25d3ac. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:34:43.100139 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:34:43.102597 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:34:43.173534 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:43.182317 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:43.183863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:43.185134 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e89a0492-d6e3-4f55-a128-34ae7f4390f4 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.178973 May 27 16:34:43.185767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 440/882] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:43 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:43.190237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:43.191692 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] [instance: 43f50a3d-9ef6-49a8-9647-b7aa583caab7] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:43.198540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.202967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.202967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:43.202967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:43.216663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] HTTP exception thrown: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Request method failure captured: May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 HTTP/1.1 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPzTZ4xq23hktyD2HU5cvtjinQ5MKQHQslLtTsvvkU-W7Cnt2be8Jk2FeqhQroVzKpMxuop3M4S39Onsx9Iqu1osuo6E5aNBexeWd1jIu4yuhbKt_ZFn-f8HEjmxx44OOmzaCyj-0lFlYv6H4F9_RE9VrIxqDNlFE3O2vQ4-OkAKS2o May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: bf8f192a31204d97b3b2e8895856a459 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:34:43.217640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf8f192a31204d97b3b2e8895856a459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf8f192a31204d97b3b2e8895856a459", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: bf8f192a31204d97b3b2e8895856a459 May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-TestMinimumBasicScenario-759095978 May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-TestMinimumBasicScenario-759095978-project May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 650592005e10426b95a76ebd97b07455 May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-TestMinimumBasicScenario-759095978-project May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. May 27 16:34:43.219239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '43f50a3d-9ef6-49a8-9647-b7aa583caab7'} May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:34:43.220094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. May 27 16:34:43.222220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:34:43.223934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Returning 404 to user: Instance 43f50a3d-9ef6-49a8-9647-b7aa583caab7 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:34:43.223934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5b391149-b908-4b55-a333-bfab545164ca tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7" status: 404 len: 111 microversion: 2.1 time: 0.032341 May 27 16:34:43.223934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 441/883] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:43 2022] GET /compute/v2.1/servers/43f50a3d-9ef6-49a8-9647-b7aa583caab7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:34:43.228830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ec712659-1bae-4d81-801f-4e83603ab8a0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] Calling method '.version_select at 0x7f0e9a026a60>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:43.245073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6959e513-d54e-4f58-ba85-c1fc1804b813 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.826355 May 27 16:34:43.245073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 443/884] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:34:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:34:43.254753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3579972b-7296-4d64-95e5-bf67bd4f34d1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:43.255492 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3579972b-7296-4d64-95e5-bf67bd4f34d1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:43.311517 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3579972b-7296-4d64-95e5-bf67bd4f34d1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:43.315839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ec712659-1bae-4d81-801f-4e83603ab8a0 tempest-TestMinimumBasicScenario-759095978 tempest-TestMinimumBasicScenario-759095978-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1566390221" status: 202 len: 0 microversion: 2.1 time: 0.090056 May 27 16:34:43.317333 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 442/885] 10.222.0.42 () {58 vars in 1271 bytes} [Fri May 27 16:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1566390221 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:34:43.320308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3579972b-7296-4d64-95e5-bf67bd4f34d1 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1242 microversion: 2.1 time: 0.070955 May 27 16:34:43.321093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 444/886] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:43 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:44.204708 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:44.205401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:44.213128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:44.213609 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:44.214389 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:44.214843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:44.337679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:44.338863 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:44.347051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:44.347516 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:44.348283 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:44.348711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:44.350523 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:44.358728 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:44.360226 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:44.361431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-146a45eb-7aac-4e7c-9abf-1d5c659862d6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.161152 May 27 16:34:44.362180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 443/887] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:44 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:44.417025 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:44.425058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7d1629ea-9d69-4675-95a3-f00b60851ca5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1246 microversion: 2.1 time: 0.091031 May 27 16:34:44.429493 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 445/888] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:44 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:45.382537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:45.383265 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:45.392811 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:45.393978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:45.395465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:45.396301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:45.448668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:45.451932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:45.471691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:45.474882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:45.478133 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:45.481455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:45.572776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:45.585976 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-207330bf-459d-44a7-8394-ccab3192824b tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1294 microversion: 2.1 time: 0.146725 May 27 16:34:45.586552 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 446/889] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:45 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:45.626034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:45.635137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:45.636769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:45.638023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25b89cfd-beba-44b2-a36b-fc99fe26b5a0 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.260865 May 27 16:34:45.638693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 444/890] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:45 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:46.604713 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:46.605379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:46.611691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:46.612632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:46.614275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:46.614451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:46.655982 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:46.656564 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:46.663957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:46.664495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:46.665306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:46.665806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:46.681381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:46.690005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fd25bcaa-47ac-4e45-a833-a400c4fbb280 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1300 microversion: 2.1 time: 0.089199 May 27 16:34:46.692235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 447/891] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:46 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:46.810087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:46.819740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:46.821162 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:46.822438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-988d974a-c7a5-4cd0-9f46-b77cd8970a85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.170375 May 27 16:34:46.825860 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 445/892] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:46 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:47.709747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:47.711102 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:47.718628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:47.719936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:47.720729 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:47.721357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:47.841570 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:47.842981 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:47.857881 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:47.860153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:47.861078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:47.861930 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:47.864460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:47.938213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:47.958989 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9758a4c0-5e42-49a5-9d86-39f114f80c37 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.254535 May 27 16:34:47.961180 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 448/893] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:47 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:48.062485 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:48.067534 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:48.069045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:48.070281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-07d9b75c-8004-4fb1-b77c-91c3859b10d7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.232677 May 27 16:34:48.070854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 446/894] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:47 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:48.976693 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:48.977326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:48.987946 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:48.988666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:48.989925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:48.990400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:48.993734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:49.093493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:49.094687 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:49.105535 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:49.106221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:49.108328 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:49.109757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:49.178306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:49.210355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-22168132-ffe4-44b6-913e-bf60f9de0686 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.236539 May 27 16:34:49.211815 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 449/895] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:48 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:49.313640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-ee180e7b-8f0b-4080-92a6-62e52d8f4e24 req-2785bfe4-83f6-42b4-8501-aa7897be92a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb857fc4-8a15-4b01-8990-a02c5fe4475c", "tag": "3dc06512-18f1-4fd2-b9b1-104f02a4f067"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:49.324890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-ee180e7b-8f0b-4080-92a6-62e52d8f4e24 req-2785bfe4-83f6-42b4-8501-aa7897be92a7 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:49.325760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-ee180e7b-8f0b-4080-92a6-62e52d8f4e24 req-2785bfe4-83f6-42b4-8501-aa7897be92a7 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:49.343446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:49.344798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-ee180e7b-8f0b-4080-92a6-62e52d8f4e24 req-2785bfe4-83f6-42b4-8501-aa7897be92a7 service nova] Creating event network-changed:3dc06512-18f1-4fd2-b9b1-104f02a4f067 for instance fb857fc4-8a15-4b01-8990-a02c5fe4475c on hv-cinder-84049 May 27 16:34:49.350928 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-ee180e7b-8f0b-4080-92a6-62e52d8f4e24 req-2785bfe4-83f6-42b4-8501-aa7897be92a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040859 May 27 16:34:49.351770 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 450/896] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:49.355666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:49.357329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:49.358859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-09fdf993-c257-4492-9463-d77bb7031002 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.271755 May 27 16:34:49.359524 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 447/897] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:49 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:50.229380 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:50.229911 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:50.236814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:50.237791 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:50.238464 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:50.238824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:50.379077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:50.380425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:50.382780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:50.388509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:50.389219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:50.390398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:50.391025 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:50.448165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:50.457621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7f056559-23cd-4f65-9b17-d5d57f0d42b6 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.233073 May 27 16:34:50.458839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 451/898] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:50 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:50.573500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:50.585986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:50.587471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:50.588627 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-05c152bd-6388-414d-989f-ad48ec1b4d73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.213553 May 27 16:34:50.589185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 448/899] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:50 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:51.474812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:51.475515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:51.482880 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.483327 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.484109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.484537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.613666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:51.618032 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:51.624222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.624671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.625768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.626203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.710568 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:51.720788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ae66bee3-9ff1-4124-8e4e-75f0dccdd562 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.249865 May 27 16:34:51.723196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 452/900] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:51 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:51.808881 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:51.809548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:51.813257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:51.820893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.822043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.831626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:51.831626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:51.832184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:51.832184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:51.832184 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4f6c2c06-f9b7-4c54-b91a-2e565debacec tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.222481 May 27 16:34:51.832457 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 449/901] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:51 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:51.849620 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-93ac4541-f9c2-49f5-90a6-f3a59e9dd4bb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/ips" status: 200 len: 145 microversion: 2.1 time: 0.044629 May 27 16:34:51.868148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 453/902] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:34:51 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/ips => generated 145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:52.739957 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:52.741208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:52.753476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:52.754503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:52.755641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:52.756231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:52.848463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:52.849964 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:52.857803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:52.858592 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:52.859605 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:52.860212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:53.049597 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:53.057498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:53.062290 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-473d4aae-6be7-42f3-a026-548d8f1109e3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.326682 May 27 16:34:53.069889 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 450/903] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:52 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:53.077497 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:53.090094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:53.099988 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:53.105909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:53.105909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cb5bb4a5-ab48-4cb2-8d4d-db17717764f2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1743 microversion: 2.20 time: 0.258701 May 27 16:34:53.105909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 454/904] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:52 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:34:53.499579 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "face9bcb-c73d-433d-bef3-0b625569d1f2"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:53.500870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:53.508033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:53.508488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:53.509678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:53.510186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:54.087385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:54.089320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:54.095802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=8 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:54.098663 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:54.099116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:54.099988 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:54.100419 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:54.321293 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:54.333635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a3c80d3f-48bb-4fe9-b837-798773e6c7b5 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.255687 May 27 16:34:54.334559 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 455/905] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:54 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:34:54.341421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:54.342632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:54.353522 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:54.355053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:54.356142 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:54.357022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:54.579823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:54.598115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:54.600809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:54.602596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f6eb98d6-cdb1-4624-a037-ec89558570c2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1743 microversion: 2.20 time: 0.266781 May 27 16:34:54.603659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 456/906] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:54 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:54.811945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eef7b02d-777c-4700-a4cf-c81dae76a1d0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.316676 May 27 16:34:54.829448 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 451/907] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:34:53 2022] POST /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:34:55.358837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:55.358837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:55.360803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:55.361259 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:55.362149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:55.363633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:55.518310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:55.530759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1f127dfe-b009-4288-a719-8d15c449d810 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.181519 May 27 16:34:55.532912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 457/908] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:55 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:55.639057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:55.640542 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:55.655016 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:55.657157 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:55.660373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:55.661552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:55.919049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:55.950606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:55.954007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:55.956260 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5d3724c7-d9d0-4766-b9f6-b8d372db861b tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.324209 May 27 16:34:55.957006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 452/909] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:55 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:56.192859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-92113317-9e08-4966-8daa-ada10ba18f2f req-0008643a-c517-4833-a803-37ca8502ae35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "name": "network-vif-plugged", "status": "completed", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:56.204980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-92113317-9e08-4966-8daa-ada10ba18f2f req-0008643a-c517-4833-a803-37ca8502ae35 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:56.204980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-92113317-9e08-4966-8daa-ada10ba18f2f req-0008643a-c517-4833-a803-37ca8502ae35 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:56.225960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-92113317-9e08-4966-8daa-ada10ba18f2f req-0008643a-c517-4833-a803-37ca8502ae35 service nova] Creating event network-vif-plugged:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:34:56.231353 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-92113317-9e08-4966-8daa-ada10ba18f2f req-0008643a-c517-4833-a803-37ca8502ae35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401714 May 27 16:34:56.232310 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 458/910] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:56.569082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:56.569867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:56.585530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:56.587997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:56.589724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:56.591334 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:56.790962 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:56.801500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6f08a8d5-64ba-4923-9bcb-056844ab3bcd tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.236142 May 27 16:34:56.802195 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 453/911] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:56 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:56.983847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:56.984611 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:56.993266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:56.994210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:56.994961 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:56.995434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:57.163106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:57.171995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:57.173776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:57.175531 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f8a311dd-eb33-42ae-926e-8386cc27e538 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.196618 May 27 16:34:57.176309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 459/912] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:56 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:57.824513 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:57.825141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:57.844915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:57.845418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:57.848113 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:57.848585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:58.124002 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:58.140296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-87403d52-4f87-4d6a-9f5c-fc9737526530 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.323639 May 27 16:34:58.148709 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 454/913] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:57 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:58.195097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:58.196350 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:58.203530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:58.204212 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:58.205446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:58.206476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:58.253931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-a3e086e4-834f-4ba3-8f24-5e8e7e3c1b60 req-5105b5d4-e357-4aa4-9361-97a05e372ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb857fc4-8a15-4b01-8990-a02c5fe4475c", "name": "network-vif-plugged", "status": "completed", "tag": "3dc06512-18f1-4fd2-b9b1-104f02a4f067"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:34:58.262247 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a3e086e4-834f-4ba3-8f24-5e8e7e3c1b60 req-5105b5d4-e357-4aa4-9361-97a05e372ead service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:58.262987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-a3e086e4-834f-4ba3-8f24-5e8e7e3c1b60 req-5105b5d4-e357-4aa4-9361-97a05e372ead service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:58.280844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-a3e086e4-834f-4ba3-8f24-5e8e7e3c1b60 req-5105b5d4-e357-4aa4-9361-97a05e372ead service nova] Creating event network-vif-plugged:3dc06512-18f1-4fd2-b9b1-104f02a4f067 for instance fb857fc4-8a15-4b01-8990-a02c5fe4475c on hv-cinder-84049 May 27 16:34:58.286773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-a3e086e4-834f-4ba3-8f24-5e8e7e3c1b60 req-5105b5d4-e357-4aa4-9361-97a05e372ead service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042971 May 27 16:34:58.287972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 455/914] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:34:58.422680 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:58.453952 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:58.459232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:58.463401 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4a5f5b41-2c6e-40d2-84de-3cf860e465b1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.272213 May 27 16:34:58.465914 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 460/915] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:58 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:34:59.165198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:59.165951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:59.173744 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:59.175399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:59.175399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:59.175600 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:59.346363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:59.356610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ebc19bea-4cbf-4501-a54c-6e472c82cefa tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.195549 May 27 16:34:59.357196 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 456/916] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:34:59 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:34:59.488712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:34:59.489383 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:34:59.495963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:59.496412 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:59.497169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:34:59.497623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:34:59.652886 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:59.661176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:59.663001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:34:59.664377 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ce445261-09da-40fe-b103-556c2ac97270 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.180219 May 27 16:34:59.665428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 461/917] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:34:59 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:00.375562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:00.376803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:00.386256 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:00.386714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:00.387487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:00.387933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:00.597027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:00.607324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-144af31e-5959-443a-aefe-be472857a8be tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1368 microversion: 2.1 time: 0.236120 May 27 16:35:00.608409 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 457/918] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:00 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:00.686157 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:00.686967 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:00.695002 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:00.696417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:00.697526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:00.698539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:00.875299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:00.890060 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:00.891589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:00.892810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-958b9745-48ae-4da4-ad28-43e094c05d4f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.213479 May 27 16:35:00.893823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 462/919] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:00 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:01.632395 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:01.634920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:01.646127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.647243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:01.647961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.648756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:01.836978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:01.845654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-21b9fbe0-479b-4299-9447-df8defac8ee0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1556 microversion: 2.1 time: 0.223577 May 27 16:35:01.857004 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 458/920] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:01 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:01.863624 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:01.864698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:01.877009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.877735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:01.879410 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.879929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:01.913066 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:01.913840 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:01.921446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.922217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:01.923505 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:01.924276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:02.020488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1ba282a6-3eb6-4dff-b82f-a9147850a018 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161779 May 27 16:35:02.021322 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 463/921] 10.222.0.42 () {58 vars in 1274 bytes} [Fri May 27 16:35:01 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:02.118449 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:02.131617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:02.133318 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:02.134534 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-edd6b7c7-ab4f-4918-a19f-62a2cab78a32 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.226111 May 27 16:35:02.135085 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 459/922] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:01 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:03.155068 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:03.155688 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:03.168634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.169245 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.170170 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.170973 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.406655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:03.419699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:03.422077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:03.423446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-821c67c8-e4ed-4bf1-ab65-fc395b53d48c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.273061 May 27 16:35:03.424340 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 464/923] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:03 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:03.690348 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:03.693399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:03.700932 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.701403 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.702780 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.703417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.759500 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-36bbd7e4-9d5d-4fa9-8389-03fda07847c6 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073611 May 27 16:35:03.760663 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 460/924] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:03 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:03.770793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:03.771204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:03.778170 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.781017 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.781984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.783857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.835086 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-12e1818a-1768-41fe-afcf-720b733004fb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2" status: 200 len: 194 microversion: 2.1 time: 0.068077 May 27 16:35:03.836451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 465/925] 10.222.0.42 () {58 vars in 1412 bytes} [Fri May 27 16:35:03 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:03.909959 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-94f17148-a513-46d2-b825-a650ec103366 req-15fce6e1-1b71-46b6-9d07-d926e3108b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb857fc4-8a15-4b01-8990-a02c5fe4475c", "tag": "3dc06512-18f1-4fd2-b9b1-104f02a4f067"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:03.920743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-94f17148-a513-46d2-b825-a650ec103366 req-15fce6e1-1b71-46b6-9d07-d926e3108b89 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:03.921848 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-94f17148-a513-46d2-b825-a650ec103366 req-15fce6e1-1b71-46b6-9d07-d926e3108b89 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:03.936804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-94f17148-a513-46d2-b825-a650ec103366 req-15fce6e1-1b71-46b6-9d07-d926e3108b89 service nova] Creating event network-changed:3dc06512-18f1-4fd2-b9b1-104f02a4f067 for instance fb857fc4-8a15-4b01-8990-a02c5fe4475c on hv-cinder-84049 May 27 16:35:03.942801 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-94f17148-a513-46d2-b825-a650ec103366 req-15fce6e1-1b71-46b6-9d07-d926e3108b89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041985 May 27 16:35:03.947896 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 461/926] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:04.442983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:04.443741 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:04.455526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:04.456029 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:04.456823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:04.459247 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:04.721646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:04.732261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:04.744105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:04.745671 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2cfa7267-421d-4bd9-9467-2329e372ff85 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.306898 May 27 16:35:04.746752 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 466/927] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:04 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:05.769676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:05.771009 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:05.785316 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:05.786329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:05.788011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:05.789067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:05.816323 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24b9d0c6-10ef-43be-adc2-837fc7844c68"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:05.818321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:05.824908 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:05.825608 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:05.826523 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:05.827118 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:05.915308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=100 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:05.974679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:05.983015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:05.984541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:05.986659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-86815fcc-5a28-4a1a-820b-f178f1f2d510 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.223511 May 27 16:35:05.998851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 462/928] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:05 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:07.006227 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:07.007026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:07.013809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.014251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:07.015011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.015464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:07.144902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:07.153276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:07.154785 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:07.155978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d1632307-f49f-4b52-ad68-da7af1238351 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.153887 May 27 16:35:07.156588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 463/929] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:07 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:07.400406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:07.401176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:07.408993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.409519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:07.410294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.410754 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:07.433561 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lazy-loading 'flavor' on Instance uuid 046e04ca-1b83-48d8-b713-ca26cce47976 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:07.484444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1625075f-b39b-465d-b94b-511a570d4260 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "POST /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.672695 May 27 16:35:07.485190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 467/930] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:35:05 2022] POST /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 194 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:07.870950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1b368222-0178-406e-afc5-138430b4b13d tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "POST /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976/action" status: 202 len: 0 microversion: 2.1 time: 0.473874 May 27 16:35:07.872250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 464/931] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:35:07 2022] POST /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:35:07.885809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:07.891512 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:07.903447 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.904550 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:07.906681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:07.907324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:08.104235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:08.115126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0e17f480-ced1-4faa-b14f-c6c0acd15471 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.237450 May 27 16:35:08.118207 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 468/932] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:07 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:08.177018 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:08.178337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:08.184836 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:08.185276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:08.186245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:08.186679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:08.206214 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:08.332885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:08.341726 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:08.343248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:08.344408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-329aa5c5-fd34-4ff3-890e-b4162d635595 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1738 microversion: 2.20 time: 0.172996 May 27 16:35:08.345000 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 465/933] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:08 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:09.135473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:09.136086 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:09.142738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:09.143190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:09.147519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:09.147519 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:09.279064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:09.287029 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c91fa370-b969-43d4-9e75-b87bd01020e2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.155411 May 27 16:35:09.287625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 469/934] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:09 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:09.365006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:09.365884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:09.373238 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:09.373968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:09.374738 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:09.375178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:09.512936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:09.521051 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:09.522571 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:09.523765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-49767598-004f-4816-9ade-b946bdf0c999 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1720 microversion: 2.20 time: 0.163872 May 27 16:35:09.524329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 466/935] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:09 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:10.304553 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:10.305213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:10.311668 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:10.312109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:10.312858 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:10.313285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:10.450429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:10.458995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9b09082c-eb86-478a-88fa-55f959a5896b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.158516 May 27 16:35:10.459696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 470/936] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:10 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:10.542568 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:10.543206 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:10.550686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:10.551150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:10.551927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:10.552369 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:10.872799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:10.874302 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:10.875834 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:10.877060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ee3b74f4-c522-49cb-9bf4-341995dab417 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1720 microversion: 2.20 time: 0.338780 May 27 16:35:10.877650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 467/937] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:10 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1720 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:11.476629 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:11.477257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:11.483841 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:11.484291 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:11.485055 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:11.485528 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:11.622699 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:11.631292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-57477203-c9f4-4618-9880-7aa1037c8ade tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.158513 May 27 16:35:11.631865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 471/938] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:11 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:11.896676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:11.897289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:11.904246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:11.906714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:11.906714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:11.906714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:12.039823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:12.047643 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:12.049113 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:12.050293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7b32b74f-da1c-4a66-a913-494e6768346d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1720 microversion: 2.20 time: 0.158210 May 27 16:35:12.057744 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 468/939] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:11 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:12.648307 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:12.649019 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:12.657235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:12.657818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:12.660545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:12.660545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:12.800929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:12.808544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-61017e93-67fc-467a-8b01-3dcdc1079a15 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.164297 May 27 16:35:12.809165 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 472/940] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:12 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:13.068011 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:13.068615 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:13.075210 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.075655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.080652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.080652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.228731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:13.242181 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:13.243695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:13.244887 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9765dfff-42e1-45df-a45b-2320e6e049b2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1663 microversion: 2.20 time: 0.180889 May 27 16:35:13.245476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 469/941] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:13 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:13.263751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96e3f5bd-0b99-42f7-ac7f-5aaceb94374e"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:13.264887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:13.267059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:13.274222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.274924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.275810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.276150 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.702701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-c40ee613-3b05-4c18-b278-d48cd12e40db req-ca7cbd87-96d0-4e95-a6cb-ec11dfa118ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "name": "network-vif-unplugged", "status": "completed", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:13.712589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c40ee613-3b05-4c18-b278-d48cd12e40db req-ca7cbd87-96d0-4e95-a6cb-ec11dfa118ec service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.713029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c40ee613-3b05-4c18-b278-d48cd12e40db req-ca7cbd87-96d0-4e95-a6cb-ec11dfa118ec service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.724335 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.compute.server_external_events [req-c40ee613-3b05-4c18-b278-d48cd12e40db req-ca7cbd87-96d0-4e95-a6cb-ec11dfa118ec service nova] Unable to find a host for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37. Dropping event network-vif-unplugged {{(pid=118488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 16:35:13.725199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-c40ee613-3b05-4c18-b278-d48cd12e40db req-ca7cbd87-96d0-4e95-a6cb-ec11dfa118ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027076 May 27 16:35:13.726146 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 470/942] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 27 16:35:13.826586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:13.827223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:13.833818 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.834445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.835457 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:13.835901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:13.979458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:13.987997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-750d1961-bc51-478c-91ca-bed62b733e58 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.164935 May 27 16:35:13.988575 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 471/943] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:13 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:14.651332 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8e1cc2fe-fa27-4ecf-b24a-2d4977625c16 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.391580 May 27 16:35:14.651947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 473/944] 10.222.0.42 () {62 vars in 1363 bytes} [Fri May 27 16:35:13 2022] POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments => generated 188 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 16:35:14.774520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:14.775024 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:14.781820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:14.782275 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:14.783191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:14.783641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.006494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:15.007469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:15.015011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.015463 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.019163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.019163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.165988 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:15.176748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2728c646-5868-41f0-864f-6d82961f2593 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.175234 May 27 16:35:15.177455 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 474/945] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:15 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:15.485613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9d303ae7-7ce5-40ab-92a2-7e7dd9e7bf84 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments/96e3f5bd-0b99-42f7-ac7f-5aaceb94374e" status: 202 len: 0 microversion: 2.20 time: 0.714858 May 27 16:35:15.486219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 472/946] 10.222.0.42 () {60 vars in 1456 bytes} [Fri May 27 16:35:14 2022] DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments/96e3f5bd-0b99-42f7-ac7f-5aaceb94374e => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 16:35:15.586767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:15.587333 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:15.594087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.594536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.595300 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.595750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.905632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-460a027a-0351-4b72-afae-5da918ef55d5 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/action" status: 202 len: 0 microversion: 2.20 time: 0.322743 May 27 16:35:15.906766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 475/947] 10.222.0.42 () {62 vars in 1318 bytes} [Fri May 27 16:35:15 2022] POST /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 16:35:15.915083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:15.915779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:15.923350 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.923806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:15.925176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:15.925631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.056251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:16.064798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:16.067129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:16.068305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bf6f8aab-964a-4f8a-8b00-ff12987df25f tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1671 microversion: 2.20 time: 0.157263 May 27 16:35:16.069098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 473/948] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:15 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:16.195670 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:16.196173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:16.202488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.202936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.203703 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.204135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.231191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:16.238498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:16.238775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.239686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.240217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.240408 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.273250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e78f2c1f-eac5-4e13-9b3d-6e04d183305a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046008 May 27 16:35:16.277037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 474/949] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:16 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:16.349196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:16.357198 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e8ae3fb9-c5ba-4b31-8b32-80b20c8f8519 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.166888 May 27 16:35:16.357868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 476/950] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:16 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:16.413983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:16.414484 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:16.420757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.421209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.422082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.422533 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.452587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4b07691f-1854-430e-959b-11f8a86f2eb3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2" status: 200 len: 194 microversion: 2.1 time: 0.043745 May 27 16:35:16.453176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 475/951] 10.222.0.42 () {58 vars in 1412 bytes} [Fri May 27 16:35:16 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:16.463949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:16.464466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:16.470603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.471078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.472484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:16.473020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:16.557228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lazy-loading 'services' on Instance uuid 727a62b9-55e0-4e2d-b773-197b092299ca {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:16.849100 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ec1def08-0030-4081-bc6d-054d62639488 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2" status: 202 len: 0 microversion: 2.1 time: 0.386180 May 27 16:35:16.849100 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 477/952] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:35:16 2022] DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/face9bcb-c73d-433d-bef3-0b625569d1f2 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:35:17.091125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:17.092472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:17.099077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:17.099523 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:17.100289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:17.100773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:17.240174 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:17.248769 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:17.250421 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:17.251639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-7cd1937c-3e4a-4c3b-bce7-ec7b91450070 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1671 microversion: 2.20 time: 0.168055 May 27 16:35:17.252200 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 476/953] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:17 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:17.380923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:17.381588 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:17.389016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:17.390589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:17.390589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:17.390869 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:17.527526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:17.529997 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:17.536385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ea6d06f5-38fe-4a31-85a3-60f5f9dd7028 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.161018 May 27 16:35:17.536974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 478/954] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:17 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:18.274996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:18.275624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:18.278078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=62 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:18.282884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:18.285580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:18.285580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:18.285580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:18.428716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:18.437624 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:18.439121 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:18.440595 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bf972d16-003f-4d4e-9294-a75413cb33aa tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.169335 May 27 16:35:18.441296 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 477/955] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:18 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:18.558821 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:18.559496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:18.568872 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:18.569795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:18.570351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:18.570793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:18.728252 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:18.733179 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9d3c9f3a-93ba-4121-af01-7224b1e79c31 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.183189 May 27 16:35:18.733787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 479/956] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:18 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:19.030625 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:19.036210 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:19.037610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.038264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.039041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.039637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.075984 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ab28a15c-9626-491f-82a5-fcc20f2b5697 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/24b9d0c6-10ef-43be-adc2-837fc7844c68" status: 200 len: 194 microversion: 2.1 time: 0.049124 May 27 16:35:19.078089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 478/957] 10.222.0.42 () {58 vars in 1412 bytes} [Fri May 27 16:35:19 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/24b9d0c6-10ef-43be-adc2-837fc7844c68 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:19.087847 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:19.088357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:19.094591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.095305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.096275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.097639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.189195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lazy-loading 'services' on Instance uuid 727a62b9-55e0-4e2d-b773-197b092299ca {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:19.460319 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:19.461012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:19.467219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.467676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.468458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.468897 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.475302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bde0de6d-02e1-4cd5-9cf7-3b5240263756 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/24b9d0c6-10ef-43be-adc2-837fc7844c68" status: 202 len: 0 microversion: 2.1 time: 0.391294 May 27 16:35:19.475893 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 480/958] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:35:19 2022] DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments/24b9d0c6-10ef-43be-adc2-837fc7844c68 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:35:19.659006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:19.667418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:19.668930 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:19.670130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25d9246d-d343-437d-8cfa-a1f79257de73 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.214312 May 27 16:35:19.670698 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 479/959] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:19 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:19.752656 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:19.753853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:19.760107 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.760556 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.761484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:19.761920 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:19.903196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:19.911234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-70697322-8ce9-48d8-8859-6886baba5189 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.163737 May 27 16:35:19.911642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 481/960] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:19 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:20.688462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:20.689185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:20.716525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:20.716525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:20.716525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:20.716525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:20.717471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:20.841216 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:20.849303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:20.850956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:20.852112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a308020e-f7e3-48f9-8a0f-9c10131c945c tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.167873 May 27 16:35:20.852676 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 480/961] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:20 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:20.928542 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:20.929075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:20.936339 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:20.936765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:20.937565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:20.937995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:21.095167 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:21.105742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b4b95096-392f-41d1-92a0-348724183630 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.179834 May 27 16:35:21.106356 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 482/962] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:20 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:21.875078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:21.875677 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:21.889127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:21.889923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:21.890730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:21.891320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:22.084686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:22.092733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:22.094329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:22.095637 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-94cc0778-4ce8-4a88-894d-509d95f38d3e tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.228561 May 27 16:35:22.096201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 481/963] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:21 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:22.124351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:22.124938 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:22.132321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:22.132760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:22.133555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:22.134024 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:22.300527 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:22.308939 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dd0e265f-3bdf-4335-84ad-e0d779e87d1c tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.188773 May 27 16:35:22.309808 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 483/964] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:22 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:22.848366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:22.850029 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:22.857673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:22.858458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:22.859393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:22.860014 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:22.914031 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bb1fae81-2f1d-4d97-9f66-639671406ba2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071317 May 27 16:35:22.920319 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 482/965] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:22 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:35:23.086949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:23.086949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:23.086949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.086949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.087643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.087643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.122063 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:23.122691 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:23.125163 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-62e57e37-687e-45b3-a25e-1065d523803f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054298 May 27 16:35:23.126117 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 484/966] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:23 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:35:23.136673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.137127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.138281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.138879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.222800 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:23.223716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:23.232401 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.233230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.235235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.235675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.279854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:35:23.347671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:23.365020 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:23.382325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:23.382325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-69b8ea9f-b4ba-408b-97b9-1154a8f4a64d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.256790 May 27 16:35:23.382325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 483/967] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:23 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:23.382325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:23.382736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:23.389017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.389573 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.390300 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.390961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.578337 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:23.589009 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f3ecb41e-659f-4138-96b2-1d80f0e16f93 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.218145 May 27 16:35:23.599664 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 484/968] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:23 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:23.663846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-eb03b910-42b9-4d0e-af78-ab50c4a22272 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 204 len: 0 microversion: 2.1 time: 0.445641 May 27 16:35:23.664429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 485/969] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:35:23 2022] DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:35:23.674224 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:23.675615 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:23.682213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.683007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.684116 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:23.684689 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:23.825987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:23.834473 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a9faf523-e363-470f-a30d-3acc151f142a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.165408 May 27 16:35:23.835062 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 485/970] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:23 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:24.391189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:24.393362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:24.401370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.401930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:24.402773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.403350 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:24.555924 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:24.564181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:24.565999 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:24.568032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c70bfa8f-ea42-47d9-ba25-c81878db4613 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.180846 May 27 16:35:24.568032 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 486/971] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:24 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:24.776993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:24.776993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:24.776993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.776993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:24.777784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.777784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:24.780830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:24.789284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-126271b0-5530-43e7-bfe5-9f72a907a71b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.186566 May 27 16:35:24.789890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 486/972] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:24 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:24.852382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:24.853015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:24.859707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.860164 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:24.860988 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:24.861454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.028280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:25.037437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-77f33fad-15b9-4cc2-91cb-854d2ea4d306 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.188875 May 27 16:35:25.038024 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 487/973] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:24 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:25.594054 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:25.595956 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:25.604714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:25.605178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.606050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:25.606489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.777724 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-62a042e3-c544-4b78-8482-c130358d43d8 req-de531fa9-effb-421a-ae21-3ff2d6e1e50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "name": "network-vif-unplugged", "status": "completed", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:25.793289 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-62a042e3-c544-4b78-8482-c130358d43d8 req-de531fa9-effb-421a-ae21-3ff2d6e1e50d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:25.793796 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-62a042e3-c544-4b78-8482-c130358d43d8 req-de531fa9-effb-421a-ae21-3ff2d6e1e50d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.811202 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-62a042e3-c544-4b78-8482-c130358d43d8 req-de531fa9-effb-421a-ae21-3ff2d6e1e50d service nova] Creating event network-vif-unplugged:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:35:25.817526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-62a042e3-c544-4b78-8482-c130358d43d8 req-de531fa9-effb-421a-ae21-3ff2d6e1e50d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045293 May 27 16:35:25.819224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 488/974] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:25.825850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:25.827126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:25.836402 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:25.837144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.838228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:25.840587 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:25.874385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:25.891391 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:25.893017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:25.897840 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-697e4dcb-9b15-498d-b2a0-1ad8146dcae7 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.315541 May 27 16:35:25.901501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 487/975] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:25 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:26.055713 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:26.056722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:26.070227 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:26.070998 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:26.071725 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:26.072797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:26.073593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:26.094687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ccb5a4b0-c11a-41f4-be12-3d75e29f5180 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.257947 May 27 16:35:26.094687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 489/976] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:25 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:26.320384 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:26.330909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9e8ea36f-a9bb-484a-bd7b-3aedadf559b4 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.278839 May 27 16:35:26.342611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 488/977] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:26 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:26.933694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:26.935051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:26.950332 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:26.951121 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:26.951978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:26.952645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:27.097254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:27.102396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:27.109285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:27.110006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:27.110951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:27.111546 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:27.144501 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:27.154234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:27.156144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:27.157677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-80548d88-c4d1-4a5e-964a-a2fe6147cd94 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.231999 May 27 16:35:27.158335 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 490/978] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:26 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:27.266182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:27.276249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-347df14d-73e4-46fd-86f5-e1aa8880468b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.182687 May 27 16:35:27.278008 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 489/979] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:27 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:27.663716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:27.663716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:27.663716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:27.663716 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:27.665871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:27.665871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:27.665871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:27.671596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ad499067-9729-4460-a260-26dd742a9dfb tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.169870 May 27 16:35:27.671596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 491/980] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:27 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:28.177949 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:28.178565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:28.200606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.201061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.201874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.202320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.298069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:28.298966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:28.312428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.312919 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.322403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.322673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.501743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:28.515444 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:28.519390 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:28.521696 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-171d5fd8-20e6-49bf-874f-b67b8ecc00c8 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.347979 May 27 16:35:28.523215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 490/981] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:28 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:28.548295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:28.548969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:28.566289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.567169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.568089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:28.568774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:28.582502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:28.590944 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-37fc92fd-ef6f-4720-ac02-bbd363e371fb tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.298112 May 27 16:35:28.602504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 492/982] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:28 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:28.734026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:28.742785 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6c08a058-af5f-4a71-99df-c7809bda94f2 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.208947 May 27 16:35:28.743371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 491/983] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:28 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:29.541543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:29.542362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:29.561027 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:29.561603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:29.562397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:29.562835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:29.609365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:29.610045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:29.620338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:29.620794 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:29.621661 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:29.622110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:30.113742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:30.113742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:30.113742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:30.114106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:30.114106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-513c2ed0-ebbf-4316-8a75-e58583ab21fb tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.565665 May 27 16:35:30.114106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 493/984] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:29 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:30.114106 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:30.114467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:30.115820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:30.116420 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:30.117235 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:30.117794 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:30.119505 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:30.132706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2d255b44-84f4-4d9d-baf4-4c34dc909072 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.527005 May 27 16:35:30.133792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 492/985] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:29 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:30.282997 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:30.290878 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-32c8f77f-2355-4996-bbcb-15c359c744c8 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.186562 May 27 16:35:30.291460 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 494/986] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:30 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:31.123436 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:31.124301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:31.131739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.132191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.132964 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.133430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.150296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:31.150901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:31.157809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.158255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.159024 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.159451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.339167 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:31.342822 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:31.347512 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:31.349726 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:31.351077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a4775700-3493-445e-ad89-474ca11b5cdc tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.231657 May 27 16:35:31.351648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 493/987] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:31 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:31.359416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2f50fa91-8c2c-4ee2-920a-3b63362c4c4f tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.205705 May 27 16:35:31.359416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 495/988] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:31 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:31.359659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:31.359659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:31.369154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.369821 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.370717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:31.371251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:31.501948 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:31.510040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-44b0a83f-666b-442e-a58a-2b29f5c8c7f0 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.157369 May 27 16:35:31.510779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 494/989] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:31 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:32.384031 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:32.384650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:32.385415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:32.386043 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:32.391400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.391885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.392591 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.392723 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.393110 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.393236 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.393903 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.394346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.596859 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:32.603215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:32.616094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:32.616094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:32.616094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cb3d66ab-e14a-47f6-bb37-1b9f15d8b542 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.229945 May 27 16:35:32.616416 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 496/990] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:32 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:32.616499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-13752c47-caa8-41e9-9486-7bef0b9031b2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1568 microversion: 2.1 time: 0.229609 May 27 16:35:32.616499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 495/991] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:32 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:32.616679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:32.616679 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:32.621486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.621934 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.622703 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.623220 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.628450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:32.629140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:32.635349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.635799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.636591 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.637028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.686645 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=100 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:32.767101 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:32.776209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-e66034cc-ea52-4969-abac-2b5675162b0c tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.165941 May 27 16:35:32.782178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 497/992] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:32 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:32.963324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4f5f938c-e20e-44fd-85d7-4644fada7b5b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "POST /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976/action" status: 202 len: 0 microversion: 2.1 time: 0.338748 May 27 16:35:32.963931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 496/993] 10.222.0.42 () {60 vars in 1277 bytes} [Fri May 27 16:35:32 2022] POST /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:35:32.972023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:32.972696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:32.980771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.981215 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:32.982016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:32.982448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:33.119393 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:33.127107 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b56270e0-ee93-494c-8cf8-57a485108ea3 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1576 microversion: 2.1 time: 0.159021 May 27 16:35:33.131665 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 498/994] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:32 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:33.627892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:33.628466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:33.635950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:33.636399 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:33.637159 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:33.637616 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:33.774918 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:33.783308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:33.784898 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:33.786262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-9987733e-855a-47a0-ae9a-3b15ccac0594 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.163074 May 27 16:35:33.795434 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 497/995] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:33 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:33.795585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:33.795585 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:33.801507 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:33.801850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:33.802638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:33.803058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:33.955227 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:33.963508 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9fc5ae81-d56c-4e22-88b7-06c421151e8f tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1671 microversion: 2.1 time: 0.173898 May 27 16:35:33.964157 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 499/996] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:33 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:34.146249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:34.146768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:34.152817 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.153285 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:34.154092 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.154525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:34.294712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:34.303271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-dad78aac-4c8d-4497-92b9-505336596829 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1576 microversion: 2.1 time: 0.161602 May 27 16:35:34.308857 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 498/997] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:34 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:34.804949 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:34.805610 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:34.812035 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.812486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:34.813275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.813740 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:34.963584 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:34.971615 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:34.973607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:34.974896 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0bf2eba2-70d7-414c-b10d-73e31c858049 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.174286 May 27 16:35:34.975461 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 500/998] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:34 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:34.982053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:34.982647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:34.989417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.989875 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:34.990641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:34.991079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:35.056832 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:35.064511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-193735cb-34f8-4b69-b1a9-65fa542c0159 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1603 microversion: 2.1 time: 0.086276 May 27 16:35:35.065087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 499/999] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:34 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1603 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:35.329698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:35.330453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:35.338198 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:35.338695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:35.339488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:35.339929 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:35.493634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:35.502681 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a5484f3a-f357-4859-830f-7603833fcafc tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1518 microversion: 2.1 time: 0.178058 May 27 16:35:35.503441 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 501/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:35 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:35.608223 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-74f26ab3-3d18-4f50-b62d-d7b6e2f91b27 req-baa7fd82-5628-49ef-958a-80485a4d488f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727a62b9-55e0-4e2d-b773-197b092299ca", "name": "network-vif-deleted", "tag": "cc40eb88-ffe4-466d-8a3d-40058b281672"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:35.617698 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-74f26ab3-3d18-4f50-b62d-d7b6e2f91b27 req-baa7fd82-5628-49ef-958a-80485a4d488f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:35.618147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-74f26ab3-3d18-4f50-b62d-d7b6e2f91b27 req-baa7fd82-5628-49ef-958a-80485a4d488f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:35.630405 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-74f26ab3-3d18-4f50-b62d-d7b6e2f91b27 req-baa7fd82-5628-49ef-958a-80485a4d488f service nova] Creating event network-vif-deleted:cc40eb88-ffe4-466d-8a3d-40058b281672 for instance 727a62b9-55e0-4e2d-b773-197b092299ca on hv-cinder-84049 May 27 16:35:35.635612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-74f26ab3-3d18-4f50-b62d-d7b6e2f91b27 req-baa7fd82-5628-49ef-958a-80485a4d488f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 May 27 16:35:35.636217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 500/1001] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:35.831368 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-5b759c17-c843-49aa-a12b-251756f322a0 req-46f97f7c-2aa6-4b43-a091-fdd7383ba202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "name": "network-vif-plugged", "status": "completed", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:35.841010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5b759c17-c843-49aa-a12b-251756f322a0 req-46f97f7c-2aa6-4b43-a091-fdd7383ba202 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:35.841394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-5b759c17-c843-49aa-a12b-251756f322a0 req-46f97f7c-2aa6-4b43-a091-fdd7383ba202 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:35.858560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-5b759c17-c843-49aa-a12b-251756f322a0 req-46f97f7c-2aa6-4b43-a091-fdd7383ba202 service nova] Creating event network-vif-plugged:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:35:35.864466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-5b759c17-c843-49aa-a12b-251756f322a0 req-46f97f7c-2aa6-4b43-a091-fdd7383ba202 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039259 May 27 16:35:35.865117 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 502/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:35.994649 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:35.995349 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:36.002526 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.003007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.003809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.004398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.085820 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:36.086765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:36.100013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.100617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.101395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.102145 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.147135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:36.155783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:36.157466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:36.158789 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-bdae2759-1fb0-495a-96ad-c0520a9a714d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.168754 May 27 16:35:36.159596 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 501/1003] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:35 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:36.178190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:36.186043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9271b0ac-955c-42c2-8054-37c158d39c5a tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1603 microversion: 2.1 time: 0.105559 May 27 16:35:36.186625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 503/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:36 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1603 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:36.521630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:36.522980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:36.529303 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.529826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.530683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:36.531366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:36.690439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:36.699186 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-77387947-825d-4d58-b8ea-e919d3bda54b tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1518 microversion: 2.1 time: 0.182783 May 27 16:35:36.699782 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 502/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:36 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:37.180840 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:37.181403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:37.188363 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.188874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.189703 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.190181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.204536 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:37.207870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:37.213515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.214033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.214908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.215447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.252868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.253433 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.254071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lazy-loading 'fault' on Instance uuid 727a62b9-55e0-4e2d-b773-197b092299ca {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:37.316094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d41932bfa94f369103ed29d29940b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953c1f6d240098f164785b8ccc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:37.323820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-388b8159-e3c2-449b-84ad-9eaaceb03785 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 200 len: 1325 microversion: 2.1 time: 0.123402 May 27 16:35:37.324659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 503/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:37 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 1325 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:37.359547 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:37.367697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:37.369191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:37.370430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5ab55ab4-0ccf-4608-bd61-41dfa9fc73c6 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.194909 May 27 16:35:37.371005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 504/1007] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:37 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:37.717720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:37.718425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:37.725482 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.726401 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.727189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:37.727630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:37.901460 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:37.909917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65bcb59a-d54b-41ba-a4f9-6b43d17406f4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1518 microversion: 2.1 time: 0.195820 May 27 16:35:37.912159 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 504/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:37 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:38.342513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:38.343117 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:38.350316 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.350758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:38.351529 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.351957 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:38.366484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca HTTP/1.1 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:35:38.368249 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:38.369909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '727a62b9-55e0-4e2d-b773-197b092299ca'} May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:38.370735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:38.372042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:38.373176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:38.373176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0825c3d2-8c1a-4d5d-bfc9-241bc6c071bf tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 404 len: 111 microversion: 2.1 time: 0.031030 May 27 16:35:38.373176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 505/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:38 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:35:38.378925 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c2a3e7af-a546-4906-8b82-9919b43117e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '.version_select at 0x7f0e9f0bf670>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:38.388175 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:38.388829 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:38.395131 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.395962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:38.396751 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.397229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:38.551976 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c2a3e7af-a546-4906-8b82-9919b43117e3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66498741" status: 202 len: 0 microversion: 2.1 time: 0.176272 May 27 16:35:38.552636 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 505/1010] 10.222.0.42 () {58 vars in 1214 bytes} [Fri May 27 16:35:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66498741 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 16:35:38.557303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:38.567645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:38.569242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:38.570448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-56520b4a-e857-4c30-88b4-81defabcdb61 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.186161 May 27 16:35:38.575972 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 506/1011] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:38 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 16:35:38.926360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:38.926985 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:38.934170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.934553 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:38.940915 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:38.941900 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:39.274103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:39.283644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4a44724e-2c6f-4b5a-905e-f9a35652b3b4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.361268 May 27 16:35:39.284592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 506/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:38 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:39.593309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:39.593941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:39.602750 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:39.605927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:39.605927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:39.605927 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:39.780226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:39.788936 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:39.790606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:39.791786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-13464f72-54b1-483e-b021-bb1392fe1b52 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1729 microversion: 2.20 time: 0.202942 May 27 16:35:39.792633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 507/1013] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:39 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:40.303279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:40.303929 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:40.311394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.311858 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.312861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.313264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.415996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:40.416784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:40.423117 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.425711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.425711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.425711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.451867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-87d030b4-ddb0-41f9-817f-f636b286245d tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/ips" status: 200 len: 148 microversion: 2.1 time: 0.040497 May 27 16:35:40.452722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 508/1014] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:35:40 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:40.460966 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:40.469040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-21d7d835-14dd-4fe5-948d-fefad5f8a3af tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.170790 May 27 16:35:40.473386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 507/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:40 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:40.811983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:40.811983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:40.818634 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.819315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.820334 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:40.821394 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:40.968014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:40.976980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:40.978427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:40.979643 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f4e62ecd-6da2-4db4-a24a-fde23058c711 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1716 microversion: 2.20 time: 0.173335 May 27 16:35:40.980424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 509/1016] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:35:40 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:35:41.487310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:41.487965 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:41.496187 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:41.496644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:41.497476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:41.497920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:41.637783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:41.645471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6a0d9574-5f4f-4ae9-9e3b-f4fa477b3927 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.162274 May 27 16:35:41.646127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 508/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:41 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:42.189216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b789ce55-d4e7-427c-a74e-d52b0537edb0"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:42.190343 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:42.197768 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.198223 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.198993 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.199428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.408783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:42.409284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:42.416777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.417225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.418023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.418490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.431926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca HTTP/1.1 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:35:42.433626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.435314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '727a62b9-55e0-4e2d-b773-197b092299ca'} May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:42.436153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.437461 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.438710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:42.438710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fb37db09-918f-4ea6-a884-30d597667c59 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 404 len: 111 microversion: 2.1 time: 0.030012 May 27 16:35:42.438710 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 509/1018] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:35:42 2022] DELETE /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:35:42.444244 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:42.444905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 727a62b9-55e0-4e2d-b773-197b092299ca] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:42.450973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.451419 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.453969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.453969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.468585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca HTTP/1.1 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:35:42.470237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.471814 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '727a62b9-55e0-4e2d-b773-197b092299ca'} May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:42.475727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. May 27 16:35:42.477868 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:42.479135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 727a62b9-55e0-4e2d-b773-197b092299ca could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:42.479135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fed4dd72-99c6-4749-a0ea-71023dbd6648 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca" status: 404 len: 111 microversion: 2.1 time: 0.032179 May 27 16:35:42.479135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 510/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:42 2022] GET /compute/v2.1/servers/727a62b9-55e0-4e2d-b773-197b092299ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:35:42.662996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:42.663934 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:42.670859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.671410 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.672262 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:42.672890 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:42.833466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:42.841850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-669350d2-1d45-438c-b640-39fa66ac9854 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.183165 May 27 16:35:42.842820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 511/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:42 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:43.007614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:43.130809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fdd95913-ac90-40e1-8561-2202a15d51c2 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "POST /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945259 May 27 16:35:43.131557 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 510/1021] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:35:42 2022] POST /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:43.858683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:43.859301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:43.866785 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.867243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.868022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.868467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.895504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:43.896717 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:43.898704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:43.903793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.904234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.904996 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.905451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.919960 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 HTTP/1.1 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:35:43.921676 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.926803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '5220d569-8535-429a-bfff-fa0955dec2c0'} May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:43.928417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.930062 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.931275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:43.931275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-983e49c6-b60a-400f-a34d-5ed02638e60e tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 404 len: 111 microversion: 2.1 time: 0.032590 May 27 16:35:43.931275 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 511/1022] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:35:43 2022] DELETE /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:35:43.931534 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:43.932336 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] [instance: 5220d569-8535-429a-bfff-fa0955dec2c0] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:43.938711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.939536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.939932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:43.940429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:43.958970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] HTTP exception thrown: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Request method failure captured: May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 HTTP/1.1 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxH7BuGfllYrP2OpSH3mGQteMMlr6MzZ3hK3PwxYFbaufFF_6XqeJ4pCHX8uBah9yADWW5puZjZrzbekgAoOWM2myO_60LICfxzbbY60tuFjWBY4FWmp8VJwxbfOGp3Ot7lFciJR_WphEjWz9n-zzs5U4yCBWGA1zARH1eyCBNlBLA May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:35:43.960573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3fa953c1f6d240098f164785b8ccc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3fa953c1f6d240098f164785b8ccc5b4", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 3fa953c1f6d240098f164785b8ccc5b4 May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104226035 May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 87d41932bfa94f369103ed29d29940b3 May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeTestJSON-104226035-project May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.962190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '5220d569-8535-429a-bfff-fa0955dec2c0'} May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:43.963673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. May 27 16:35:43.965246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:35:43.966640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] Returning 404 to user: Instance 5220d569-8535-429a-bfff-fa0955dec2c0 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:43.966640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2f8c0588-1ff1-45d7-b10b-016c2254eaf3 tempest-AttachVolumeTestJSON-104226035 tempest-AttachVolumeTestJSON-104226035-project] 10.222.0.42 "GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0" status: 404 len: 111 microversion: 2.1 time: 0.034291 May 27 16:35:43.966640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 512/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:43 2022] GET /compute/v2.1/servers/5220d569-8535-429a-bfff-fa0955dec2c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 16:35:44.028419 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:44.036425 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3009bc06-07bc-45d1-9493-45300835f080 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.181721 May 27 16:35:44.037274 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 512/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:43 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:45.054129 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:45.054749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:45.061917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:45.067147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:45.067147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:45.067147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:45.225854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:45.235837 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1c0facb0-b907-46e1-9206-08b82d3067d4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.185590 May 27 16:35:45.236576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 513/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:45 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:46.255820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:46.255820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:46.262122 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:46.262805 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:46.263895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:46.264199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:46.431241 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:46.439757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d9e69433-be72-45d9-bad1-e92906c4dc82 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.190148 May 27 16:35:46.449501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 513/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:46 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:47.460392 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:47.461005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:47.467673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:47.468112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:47.468879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:47.469318 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:47.622807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:47.631410 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-66bf395a-75e1-4527-b08f-5e71b15ff410 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.175451 May 27 16:35:47.631981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 514/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:47 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:48.648378 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:48.648928 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:48.651479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:48.656250 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:48.656695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:48.657487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:48.657920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:48.796393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:48.805428 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-24a9ffb6-3fe3-489c-a2fa-e763d8236445 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.161154 May 27 16:35:48.806171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 514/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:48 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:49.598677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1c692118-1202-4b36-841c-ae6978465e4d tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Action: 'create', calling method: .version_select at 0x7f0e9963d670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-226449253", "metadata": {"Type": "work"}}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:49.827588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:49.828815 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:49.836775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:49.837450 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:49.840363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:49.840363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:49.845662 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.987003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:49.995736 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-aa1c5f2d-257c-4a81-8a39-dfda7e84728e tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.172583 May 27 16:35:49.996467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 515/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:49 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:50.000910 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-c5d91cc0-9d44-413b-9017-491ae13c62a5 req-f6960822-15a8-485f-a9b9-8c55c0ba4d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "name": "network-vif-plugged", "status": "completed", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:50.010404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c5d91cc0-9d44-413b-9017-491ae13c62a5 req-f6960822-15a8-485f-a9b9-8c55c0ba4d0b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:50.010980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-c5d91cc0-9d44-413b-9017-491ae13c62a5 req-f6960822-15a8-485f-a9b9-8c55c0ba4d0b service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:50.023083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-c5d91cc0-9d44-413b-9017-491ae13c62a5 req-f6960822-15a8-485f-a9b9-8c55c0ba4d0b service nova] Creating event network-vif-plugged:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:35:50.028456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-c5d91cc0-9d44-413b-9017-491ae13c62a5 req-f6960822-15a8-485f-a9b9-8c55c0ba4d0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 May 27 16:35:50.029424 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 516/1030] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:50.473330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1c692118-1202-4b36-841c-ae6978465e4d tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.008534 May 27 16:35:50.480694 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 515/1031] 10.222.0.42 () {60 vars in 1155 bytes} [Fri May 27 16:35:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1010 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 16:35:50.487731 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-069fd88d-0fb3-447f-934a-b068aa341de7 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e99ef5310>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:50.550767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-069fd88d-0fb3-447f-934a-b068aa341de7 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 200 len: 352 microversion: 2.1 time: 0.067533 May 27 16:35:50.551594 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 517/1032] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:50 2022] GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:51.014831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:51.015486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:51.023642 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:51.024234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:51.025072 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:51.025649 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:51.169210 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:51.179138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7579ddc6-8c83-474d-80d1-dbdb4ceec7d2 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.168577 May 27 16:35:51.179714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 516/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:51 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:51.565452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d2f72a7e-5bb8-4c26-b43a-6f7879c4cc65 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e9efa5280>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:51.621611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d2f72a7e-5bb8-4c26-b43a-6f7879c4cc65 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 200 len: 353 microversion: 2.1 time: 0.060933 May 27 16:35:51.624010 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 518/1034] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:51 2022] GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:51.633917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d93b1a86-acf8-4d99-bc9e-d53473af1efc tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e9956dee0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:51.685853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d93b1a86-acf8-4d99-bc9e-d53473af1efc tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 200 len: 353 microversion: 2.1 time: 0.055621 May 27 16:35:51.686516 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 517/1035] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:51 2022] GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:51.700397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f23e825b-fb68-450f-83e9-def2f097cd75 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e99f65160>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:51.860046 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:51.860626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:51.867064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:51.867515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:51.868282 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:51.868720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:51.951971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'services' on Instance uuid fb857fc4-8a15-4b01-8990-a02c5fe4475c {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:52.035086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f23e825b-fb68-450f-83e9-def2f097cd75 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 202 len: 0 microversion: 2.1 time: 0.339206 May 27 16:35:52.035770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 519/1036] 10.222.0.42 () {58 vars in 1247 bytes} [Fri May 27 16:35:51 2022] DELETE /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:35:52.044028 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-cb410179-65ce-4943-993b-1eca653737fe tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e9efa5430>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:52.093858 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-cb410179-65ce-4943-993b-1eca653737fe tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 200 len: 352 microversion: 2.1 time: 0.053282 May 27 16:35:52.094472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 520/1037] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:52 2022] GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:52.197626 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:52.198471 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:52.205323 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:52.209173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:52.209173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:52.209173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:52.305891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-19e2a997-e486-4e66-b6b3-c760b5850a36 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments/b789ce55-d4e7-427c-a74e-d52b0537edb0" status: 202 len: 0 microversion: 2.1 time: 0.449893 May 27 16:35:52.315855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 518/1038] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:35:51 2022] DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments/b789ce55-d4e7-427c-a74e-d52b0537edb0 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:35:52.316326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:52.317432 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:52.325600 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:52.326226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:52.327011 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:52.327484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:52.350766 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:52.359104 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3943334b-386b-4ac0-8b09-ac9b934a6633 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1574 microversion: 2.1 time: 0.166723 May 27 16:35:52.359717 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 521/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:52 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:52.360900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-45db93cb-43c1-4a37-8f38-792ce97a1299 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048790 May 27 16:35:52.365832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 519/1040] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:52 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:35:53.106373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b4a4c7df-125e-4e26-987b-16a732e609a5 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Calling method '.version_select at 0x7f0e9efa5280>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:53.138572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-b4a4c7df-125e-4e26-987b-16a732e609a5 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] HTTP exception thrown: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b4a4c7df-125e-4e26-987b-16a732e609a5 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Request method failure captured: May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 HTTP/1.1 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikP3lLY0VuYngJ58vxtscIgyXLY4sHqKb-WOnbv4eARQtnuNePstiUrf5ZUj-zT4m2-IH0KY6k5I9Q27YlCPi-3L3pmZBGcz9JRLHW3dY7FuxeQE76bwFBgrWQ0BQw6MUFXKv314DJ9ylNGnsD9E-07VRmoGahDWOcvpn0tcb4lzHxvQ May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 04cb1199226645fba8c2bc7dca36e038 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-VolumesGetTestJSON-245125741 May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:35:53.140722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/04cb1199226645fba8c2bc7dca36e038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/04cb1199226645fba8c2bc7dca36e038"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/04cb1199226645fba8c2bc7dca36e038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_04cb1199226645fba8c2bc7dca36e038", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-VolumesGetTestJSON-245125741 May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 04cb1199226645fba8c2bc7dca36e038 May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-VolumesGetTestJSON-245125741 May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-VolumesGetTestJSON-245125741-project May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 9aa0097e93bf4b8d8da23234fae0e475 May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-VolumesGetTestJSON-245125741-project May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'c1e3c753-5f69-4e0d-992c-e5ee84a03ee4'} May 27 16:35:53.143695 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. (HTTP 404) (Request-ID: req-ac662166-a3d3-4891-97bc-9ddf7782cc5a) May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:53.144746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 16:35:53.148886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 16:35:53.150914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b4a4c7df-125e-4e26-987b-16a732e609a5 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] Returning 404 to user: Volume c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b4a4c7df-125e-4e26-987b-16a732e609a5 tempest-VolumesGetTestJSON-245125741 tempest-VolumesGetTestJSON-245125741-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4" status: 404 len: 109 microversion: 2.1 time: 0.039689 May 27 16:35:53.152346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 522/1041] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:53 2022] GET /compute/v2.1/os-volumes/c1e3c753-5f69-4e0d-992c-e5ee84a03ee4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:35:53.372711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:53.374079 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:53.379605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:53.380859 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:53.382147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:53.382598 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:53.383372 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:53.383807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:53.388797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:53.389298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:53.390260 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:53.390768 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:53.417198 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bd2c63c7-d841-4c5c-8f2c-6ab945bab982 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 May 27 16:35:53.421579 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 520/1042] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:53 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:53.539169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:53.547503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-61ff7189-78a4-4e43-ad30-3cc38faa5e80 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1561 microversion: 2.1 time: 0.172356 May 27 16:35:53.548234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 523/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:53 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:54.430666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:54.431601 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:54.438518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.439047 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:54.439831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.440278 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:54.474963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6ce46efd-ec87-437b-8d06-7c515ca0df9c tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048882 May 27 16:35:54.475552 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 521/1044] 10.222.0.42 () {58 vars in 1301 bytes} [Fri May 27 16:35:54 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 16:35:54.534101 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:54.537042 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:54.542001 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.542443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:54.543201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.543631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:54.570563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:35:54.836465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-387bce65-b3b6-4964-93cd-c7225b5b106f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 204 len: 0 microversion: 2.1 time: 0.305867 May 27 16:35:54.837221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 524/1045] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:35:54 2022] DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:35:54.851567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:54.852898 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:54.859362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.859807 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:54.860596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:54.861039 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:55.002312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:55.011376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a94ec7c1-5c24-477d-936d-c4263e3325b0 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1681 microversion: 2.1 time: 0.164633 May 27 16:35:55.012050 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 522/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:54 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:56.030072 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:56.030788 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:56.039077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:56.039529 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:56.040314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:56.040784 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:56.195734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:56.203498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a7c28af1-e485-44b1-9853-0a63ec7dbbdc tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1681 microversion: 2.1 time: 0.177775 May 27 16:35:56.204071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 525/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:56 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:57.223563 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:57.224444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:57.231036 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:57.231504 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:57.232238 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:57.232675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:57.372189 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:57.380614 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f89420ed-c4ce-4baf-9168-e0923f9e72d3 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1681 microversion: 2.1 time: 0.161463 May 27 16:35:57.383995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 523/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:57 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:35:57.430189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-da5da970-1c72-4f42-9c99-6a2cc1a6f657 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e9a015310>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:57.491082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-da5da970-1c72-4f42-9c99-6a2cc1a6f657 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aec36a44-05bb-4525-a46e-5aaf8bd6769c" status: 200 len: 350 microversion: 2.1 time: 0.065428 May 27 16:35:57.491951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 526/1049] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:57 2022] GET /compute/v2.1/os-volumes/aec36a44-05bb-4525-a46e-5aaf8bd6769c => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:57.631662 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-3822bdd4-ae3a-458b-bc66-28484ef7eb9f req-b945c36b-47d8-41b8-95a0-09d6dcb72c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb857fc4-8a15-4b01-8990-a02c5fe4475c", "name": "network-vif-deleted", "tag": "3dc06512-18f1-4fd2-b9b1-104f02a4f067"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:35:57.647776 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3822bdd4-ae3a-458b-bc66-28484ef7eb9f req-b945c36b-47d8-41b8-95a0-09d6dcb72c5a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:57.649181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-3822bdd4-ae3a-458b-bc66-28484ef7eb9f req-b945c36b-47d8-41b8-95a0-09d6dcb72c5a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:57.663128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-3822bdd4-ae3a-458b-bc66-28484ef7eb9f req-b945c36b-47d8-41b8-95a0-09d6dcb72c5a service nova] Creating event network-vif-deleted:3dc06512-18f1-4fd2-b9b1-104f02a4f067 for instance fb857fc4-8a15-4b01-8990-a02c5fe4475c on hv-cinder-84049 May 27 16:35:57.670088 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-3822bdd4-ae3a-458b-bc66-28484ef7eb9f req-b945c36b-47d8-41b8-95a0-09d6dcb72c5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041998 May 27 16:35:57.670901 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 524/1050] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:58.399878 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:58.400417 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:58.406855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:58.407309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:58.408076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:58.408532 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:58.447281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:58.447937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:58.448178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lazy-loading 'fault' on Instance uuid fb857fc4-8a15-4b01-8990-a02c5fe4475c {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:35:58.503344 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56799d191ffe4193918fa0221c27c0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c409475791e243108336a3cd2e25d3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:35:58.511404 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e8f42354-1248-4876-92de-dc92aad75c81 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 200 len: 1332 microversion: 2.1 time: 0.116092 May 27 16:35:58.511946 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 527/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:58 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:35:59.278481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-150e3594-015f-493d-8e28-a48193c32f24 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e997c73a0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:59.326802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-150e3594-015f-493d-8e28-a48193c32f24 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dabd78ee-720f-4b12-b724-f18e05c77dff" status: 200 len: 351 microversion: 2.1 time: 0.052806 May 27 16:35:59.327375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 525/1052] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:35:59 2022] GET /compute/v2.1/os-volumes/dabd78ee-720f-4b12-b724-f18e05c77dff => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:35:59.539369 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:59.540017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:35:59.546773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:59.547313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:59.548089 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:35:59.548517 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:35:59.562766 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c HTTP/1.1 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:35:59.564487 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:35:59.566310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'fb857fc4-8a15-4b01-8990-a02c5fe4475c'} May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:35:59.567096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:35:59.568539 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:35:59.569752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:35:59.569752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-622e4265-7620-48bd-9b38-77266d3ba396 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 404 len: 111 microversion: 2.1 time: 0.031458 May 27 16:35:59.569752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 528/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:35:59 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:35:59.575540 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a89f4000-9d4c-45e1-a446-202c1ea167df tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '.version_select at 0x7f0e99605160>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:35:59.722790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a89f4000-9d4c-45e1-a446-202c1ea167df tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322657184" status: 202 len: 0 microversion: 2.1 time: 0.151239 May 27 16:35:59.723454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 526/1054] 10.222.0.42 () {58 vars in 1220 bytes} [Fri May 27 16:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322657184 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:36:00.984080 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c108d45b-89fc-4b16-9590-fffbd45c4776 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e99ec7a60>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.034194 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c108d45b-89fc-4b16-9590-fffbd45c4776 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/1f777d4b-f40c-4ae5-b63e-290eac4d16ce" status: 200 len: 348 microversion: 2.1 time: 0.053827 May 27 16:36:01.034799 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 529/1055] 10.222.0.42 () {58 vars in 1244 bytes} [Fri May 27 16:36:00 2022] GET /compute/v2.1/os-volumes/1f777d4b-f40c-4ae5-b63e-290eac4d16ce => generated 348 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:01.046260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d247c976-2b89-44ce-85f1-0a6075fc459b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e996fa940>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.129853 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d247c976-2b89-44ce-85f1-0a6075fc459b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.087316 May 27 16:36:01.130633 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 527/1056] 10.222.0.42 () {58 vars in 1133 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:36:01.146586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6bc4b5b7-3ebe-457f-af09-b55085e8f150 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e99e82ee0>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.228993 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6bc4b5b7-3ebe-457f-af09-b55085e8f150 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086037 May 27 16:36:01.234798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 530/1057] 10.222.0.42 () {58 vars in 1148 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:01.242266 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c63f0a41-16c5-48ee-bf1e-3a670cfbe2de tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e997433a0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.326061 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c63f0a41-16c5-48ee-bf1e-3a670cfbe2de tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.088092 May 27 16:36:01.326641 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 528/1058] 10.222.0.42 () {58 vars in 1133 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:36:01.338497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e22bd528-0fe5-4d8e-8bda-533b6f488e8b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e99ec7670>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.424322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e22bd528-0fe5-4d8e-8bda-533b6f488e8b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089664 May 27 16:36:01.424902 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 531/1059] 10.222.0.42 () {58 vars in 1166 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:01.437703 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-752244d3-ca88-49be-b042-beef6c3309de tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e995eaa60>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.518292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-752244d3-ca88-49be-b042-beef6c3309de tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.084943 May 27 16:36:01.518874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 529/1060] 10.222.0.42 () {58 vars in 1169 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:01.531254 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0f08b3c8-0385-43e3-93b0-0eefc63edccd tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e9efa5430>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.616565 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0f08b3c8-0385-43e3-93b0-0eefc63edccd tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.088999 May 27 16:36:01.617176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 532/1061] 10.222.0.42 () {58 vars in 1154 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:36:01.629975 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-63f3f591-15e2-48a3-9987-d86b071b1ff1 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e995ea700>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.721733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-63f3f591-15e2-48a3-9987-d86b071b1ff1 tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095338 May 27 16:36:01.722305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 530/1062] 10.222.0.42 () {58 vars in 1187 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:01.734666 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0e7f2a52-c07b-4198-b893-15bb0e646a1b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] Calling method '.version_select at 0x7f0e9a015790>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.816277 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0e7f2a52-c07b-4198-b893-15bb0e646a1b tempest-VolumesTestJSON-195241572 tempest-VolumesTestJSON-195241572-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.085350 May 27 16:36:01.816937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 533/1063] 10.222.0.42 () {58 vars in 1154 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:36:01.834720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.834720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:01.842221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:01.842755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:01.843817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:01.844324 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:01.859930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c HTTP/1.1 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:01.861714 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.863082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'fb857fc4-8a15-4b01-8990-a02c5fe4475c'} May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:01.863865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.866566 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:01.869271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:01.869271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-aad14bd6-cc40-4822-9000-71a06120c392 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 404 len: 111 microversion: 2.1 time: 0.037643 May 27 16:36:01.869271 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 531/1064] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:36:01 2022] DELETE /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:01.872748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:01.873393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: fb857fc4-8a15-4b01-8990-a02c5fe4475c] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:01.879630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:01.880125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:01.881055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:01.881519 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:01.894602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c HTTP/1.1 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:01.896128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.898462 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'fb857fc4-8a15-4b01-8990-a02c5fe4475c'} May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:01.899522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. May 27 16:36:01.901407 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:01.903549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance fb857fc4-8a15-4b01-8990-a02c5fe4475c could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:01.903549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1fb81ca1-3332-47d2-8691-5907c64e7cae tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c" status: 404 len: 111 microversion: 2.1 time: 0.028583 May 27 16:36:01.903549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 534/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:36:01 2022] GET /compute/v2.1/servers/fb857fc4-8a15-4b01-8990-a02c5fe4475c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:03.267051 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:03.267591 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:03.274976 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.275418 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.276196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.276629 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.291225 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db HTTP/1.1 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:03.292773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.295005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'f39837af-b086-4ba6-94cb-26c49dc4a2db'} May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:03.295921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.297473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.298915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:03.298915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-131a104b-dd6c-46c8-85f8-722c255fcbd9 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 404 len: 111 microversion: 2.1 time: 0.031201 May 27 16:36:03.298915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 532/1066] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:36:03 2022] DELETE /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:03.304224 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:03.304830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: f39837af-b086-4ba6-94cb-26c49dc4a2db] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:03.311467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.311914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.312669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.313098 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.327219 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db HTTP/1.1 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:03.328764 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.330394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'f39837af-b086-4ba6-94cb-26c49dc4a2db'} May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:03.331295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. May 27 16:36:03.332826 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.335094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance f39837af-b086-4ba6-94cb-26c49dc4a2db could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:03.335094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c8b9742a-e6af-4c98-bf7b-9f5f69255752 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db" status: 404 len: 111 microversion: 2.1 time: 0.030949 May 27 16:36:03.335094 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 535/1067] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:36:03 2022] GET /compute/v2.1/servers/f39837af-b086-4ba6-94cb-26c49dc4a2db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:03.343329 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:03.344042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:03.354044 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.354778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.355995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.356442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.371531 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f HTTP/1.1 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:03.373083 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.375038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'a6f4d9f6-9829-4b8d-96f2-982a04b2851f'} May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:03.376030 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.377733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:03.379569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:03.379569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6e9c2d9b-9942-46f2-9396-373585cddb30 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 404 len: 111 microversion: 2.1 time: 0.037350 May 27 16:36:03.379569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 533/1068] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:36:03 2022] DELETE /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:03.383554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:03.384159 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: a6f4d9f6-9829-4b8d-96f2-982a04b2851f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:03.390474 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.390922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.391684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:03.392114 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:03.406023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f HTTP/1.1 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:03.407552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.409192 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'a6f4d9f6-9829-4b8d-96f2-982a04b2851f'} May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:03.410027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. May 27 16:36:03.411253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:03.412983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance a6f4d9f6-9829-4b8d-96f2-982a04b2851f could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:03.412983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-23469c3d-11ac-4c84-864f-2326c5f9449f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f" status: 404 len: 111 microversion: 2.1 time: 0.029464 May 27 16:36:03.412983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 536/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:36:03 2022] GET /compute/v2.1/servers/a6f4d9f6-9829-4b8d-96f2-982a04b2851f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:04.766677 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:04.767222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:04.774597 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:04.775040 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:04.775842 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:04.776279 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:04.794006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af HTTP/1.1 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:04.795594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.797305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '3034be98-8230-4ba1-bfd9-cb4e4cf776af'} May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:04.798309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.799623 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:04.800930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:04.800930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4c401d69-933a-47dc-88ad-931d4330aa3f tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 404 len: 111 microversion: 2.1 time: 0.034257 May 27 16:36:04.800930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 534/1070] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:36:04 2022] DELETE /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:04.806562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:04.807255 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] [instance: 3034be98-8230-4ba1-bfd9-cb4e4cf776af] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:04.814267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:04.814989 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:04.816257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:04.817023 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:04.835892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] HTTP exception thrown: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Request method failure captured: May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af HTTP/1.1 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxFzYfTomx838MMDvbCj-HGgruBErC4OJOjHU80oLkE3esEpuXYgT8Dld9noV_PhwjnSy3E2xmNzUj7aCxzVP5iGaTGrfd873ROZKoA_TjaSk5r0gkNyDMyxYLgcZJHq9HHocJd78aSefJNM25GA8mFy2lewjqMA7YyXNCa6zQNte0 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:04.837466 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c409475791e243108336a3cd2e25d3ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c409475791e243108336a3cd2e25d3ac", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: c409475791e243108336a3cd2e25d3ac May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963779769 May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 56799d191ffe4193918fa0221c27c0e0 May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeNegativeTest-963779769-project May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.839246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '3034be98-8230-4ba1-bfd9-cb4e4cf776af'} May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:04.840047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. May 27 16:36:04.841639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:04.842798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] Returning 404 to user: Instance 3034be98-8230-4ba1-bfd9-cb4e4cf776af could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:04.842798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25528e4a-96dd-48d8-ace0-b3f7863c0c67 tempest-AttachVolumeNegativeTest-963779769 tempest-AttachVolumeNegativeTest-963779769-project] 10.222.0.42 "GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af" status: 404 len: 111 microversion: 2.1 time: 0.036327 May 27 16:36:04.842798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 537/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:36:04 2022] GET /compute/v2.1/servers/3034be98-8230-4ba1-bfd9-cb4e4cf776af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:36:14.440384 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:14.441401 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:14.455549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.455549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:14.455549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.455549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:14.455836 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=72 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:14.484830 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2ae92279-d171-4205-936a-d0e95fa29a6a tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048758 May 27 16:36:14.490281 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 535/1072] 10.222.0.42 () {60 vars in 1342 bytes} [Fri May 27 16:36:14 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:36:14.554163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:14.555325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:14.560967 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.561446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:14.562207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.562639 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:14.594154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:36:14.932642 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6bad8041-2912-4c4c-9772-021463d37ea2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 204 len: 0 microversion: 2.20 time: 0.382160 May 27 16:36:14.933229 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 538/1073] 10.222.0.42 () {60 vars in 1279 bytes} [Fri May 27 16:36:14 2022] DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 16:36:14.944518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:14.944518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:14.952535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.953213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:14.953812 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:14.954253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:15.149870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:15.160554 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:15.162103 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:15.164263 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8682d552-4e7f-45ae-b4fb-ba71cb8c44e2 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.225971 May 27 16:36:15.165698 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 536/1074] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:14 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:36:16.185724 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:16.186581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:16.193365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:16.194371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:16.195356 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:16.196170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:16.343412 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:16.353678 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:16.355246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:16.356438 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d798395b-9d6e-4659-8d94-ac64bec59721 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1722 microversion: 2.20 time: 0.175076 May 27 16:36:16.357038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 539/1075] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:16 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:36:17.376695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:17.377505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:17.380010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:17.386381 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:17.386832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:17.388369 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:17.388857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:17.456491 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:17.467227 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:17.468902 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:17.470443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-837b4548-11bd-4448-a6e5-08562391e832 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1656 microversion: 2.20 time: 0.098067 May 27 16:36:17.471022 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 537/1076] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:17 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:36:17.723266 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-6fedc5ab-b618-4be2-9249-f8e9343287ed req-27f72464-37aa-481a-be8f-7ef41fc8f209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b0b84c-8f9d-442f-a24d-250c3596bd37", "name": "network-vif-deleted", "tag": "8356222d-c6d4-41f6-8eb8-8db73dcb6d34"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:36:17.754007 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6fedc5ab-b618-4be2-9249-f8e9343287ed req-27f72464-37aa-481a-be8f-7ef41fc8f209 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:17.758035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6fedc5ab-b618-4be2-9249-f8e9343287ed req-27f72464-37aa-481a-be8f-7ef41fc8f209 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:17.770595 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-6fedc5ab-b618-4be2-9249-f8e9343287ed req-27f72464-37aa-481a-be8f-7ef41fc8f209 service nova] Creating event network-vif-deleted:8356222d-c6d4-41f6-8eb8-8db73dcb6d34 for instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 on hv-cinder-84049 May 27 16:36:17.779579 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-6fedc5ab-b618-4be2-9249-f8e9343287ed req-27f72464-37aa-481a-be8f-7ef41fc8f209 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059236 May 27 16:36:17.780463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 540/1077] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:36:18.490020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:18.490685 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:18.497260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:18.497728 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:18.498733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:18.499166 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:18.533684 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:18.534127 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:18.534576 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.objects.instance [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lazy-loading 'fault' on Instance uuid 78b0b84c-8f9d-442f-a24d-250c3596bd37 {{(pid=118487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:36:18.581277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:18.591260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:18.593192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '391d41dab9294cd39d3b80d60570034e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab6251a87c4271b77242545ef4837f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:36:18.594512 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-577f44f5-7b22-4d2e-82ad-3554e15ddd49 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 200 len: 1371 microversion: 2.20 time: 0.108759 May 27 16:36:18.596097 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 538/1078] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:18 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 16:36:19.614222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:19.614922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:19.623041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:19.623756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:19.624530 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:19.625003 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:19.638996 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 HTTP/1.1 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:19.640630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:19.645563 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '78b0b84c-8f9d-442f-a24d-250c3596bd37'} May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:19.646375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:19.647844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:19.649798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:19.649798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ec017566-e0ae-4749-9793-4db671bc4109 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 404 len: 111 microversion: 2.20 time: 0.032167 May 27 16:36:19.649798 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 541/1079] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:19 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:36:19.651021 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4120a24f-90d3-4457-8c86-286ce6d49eb1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '.version_select at 0x7f0e997ce040>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:19.734314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4120a24f-90d3-4457-8c86-286ce6d49eb1 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-439619639" status: 204 len: 0 microversion: 2.20 time: 0.086973 May 27 16:36:19.734914 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 539/1080] 10.222.0.42 () {60 vars in 1258 bytes} [Fri May 27 16:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-439619639 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 16:36:21.895669 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:21.896566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:21.899742 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:21.904899 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:21.905363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:21.906235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:21.906713 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:21.910061 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:21.925714 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 HTTP/1.1 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:21.927281 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.929437 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '78b0b84c-8f9d-442f-a24d-250c3596bd37'} May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:21.930478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.932069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:21.934452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:21.934452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a1b4f0f7-38b5-4773-8c89-7ef2d1538a56 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 404 len: 111 microversion: 2.20 time: 0.037202 May 27 16:36:21.934452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 542/1081] 10.222.0.42 () {60 vars in 1279 bytes} [Fri May 27 16:36:21 2022] DELETE /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:36:21.948427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:21.948427 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 78b0b84c-8f9d-442f-a24d-250c3596bd37] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:21.952977 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:21.953468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:21.954246 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:21.954687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:21.970580 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 HTTP/1.1 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:21.972188 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.981889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '78b0b84c-8f9d-442f-a24d-250c3596bd37'} May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:21.983561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. May 27 16:36:21.986805 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:21.990251 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 78b0b84c-8f9d-442f-a24d-250c3596bd37 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:21.990251 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-736dd556-aad0-4e1e-b884-3922b01d9f9d tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37" status: 404 len: 111 microversion: 2.20 time: 0.034876 May 27 16:36:21.990251 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 540/1082] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:21 2022] GET /compute/v2.1/servers/78b0b84c-8f9d-442f-a24d-250c3596bd37 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:36:23.348753 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:23.349374 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:23.358641 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:23.359096 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:23.359895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:23.360340 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:23.376170 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f HTTP/1.1 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:36:23.377797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.379464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '491e3f1a-4810-4313-afad-ed811fb2bc9f'} May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:23.380243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.386331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:36:23.387870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:23.387870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5bcc89b4-f1e2-49a4-9bbc-3bb06ae2f8cf tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 404 len: 111 microversion: 2.20 time: 0.034704 May 27 16:36:23.387870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 543/1083] 10.222.0.42 () {60 vars in 1279 bytes} [Fri May 27 16:36:23 2022] DELETE /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:36:23.391285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:36:23.391900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] [instance: 491e3f1a-4810-4313-afad-ed811fb2bc9f] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:36:23.399092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:23.399539 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:23.400328 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:36:23.400767 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:36:23.414609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] HTTP exception thrown: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Request method failure captured: May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f HTTP/1.1 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPxBHX0CWaljba0u7R5d6HTJpeUJ-jPxFH-v7IDfLif1b_GFu3slFFzIExsvpFOdBuoTaaAb01Qo43SMd_w3UL_wTY-A0R3CXwSPnhHaCGSNIHzTL9dA_CYU5fv0FwX6hNbTUu4XGcdZWygB9PTfVaEQOTtwboRTHfxxRFKsbFdTtCE May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Openstack-Nova-Api-Version: 2.20 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:36:23.418867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/26ab6251a87c4271b77242545ef4837f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_26ab6251a87c4271b77242545ef4837f", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: 26ab6251a87c4271b77242545ef4837f May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902823395 May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 391d41dab9294cd39d3b80d60570034e May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902823395-project May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.420320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '491e3f1a-4810-4313-afad-ed811fb2bc9f'} May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:36:23.421065 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. May 27 16:36:23.422622 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:36:23.424169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] Returning 404 to user: Instance 491e3f1a-4810-4313-afad-ed811fb2bc9f could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:36:23.424169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-469aabc3-74ed-4321-8731-2d2ee2b34a15 tempest-AttachVolumeShelveTestJSON-902823395 tempest-AttachVolumeShelveTestJSON-902823395-project] 10.222.0.42 "GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f" status: 404 len: 111 microversion: 2.20 time: 0.032436 May 27 16:36:23.424169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 541/1084] 10.222.0.42 () {60 vars in 1276 bytes} [Fri May 27 16:36:23 2022] GET /compute/v2.1/servers/491e3f1a-4810-4313-afad-ed811fb2bc9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 16:37:10.773102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1488445675", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452"}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:10.830668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] validate_networks() for None {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:37:11.119650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:37:11.120069 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:37:11.120543 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:37:11.120952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:37:11.121394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:37:11.130880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:11.131327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:11.132123 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:11.132561 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:11.150294 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Getting quotas for project f8bb35ed1e9440dbb0fe8bb80feb3982. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:37:11.155650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Getting quotas for user ac5541cb2c684bf1850140fa3d766955 and project f8bb35ed1e9440dbb0fe8bb80feb3982. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:37:11.167613 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:37:11.170723 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:37:11.311199 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6cae6114-519a-42fb-884d-7c57dc7bc4b8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541873 May 27 16:37:11.313191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 544/1085] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:37:11.322124 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-88809208-ee0a-4c1d-80e2-cf38a18d4cff tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:11.322754 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-88809208-ee0a-4c1d-80e2-cf38a18d4cff tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:11.325650 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:11.326424 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=29 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:11.387395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-88809208-ee0a-4c1d-80e2-cf38a18d4cff tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:11.396465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-88809208-ee0a-4c1d-80e2-cf38a18d4cff tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1215 microversion: 2.1 time: 0.078116 May 27 16:37:11.397177 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 542/1086] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:11 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:12.422490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4c834de9-4950-4ee8-b76f-ced1abe3d75d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:12.423777 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4c834de9-4950-4ee8-b76f-ced1abe3d75d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:12.497492 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4c834de9-4950-4ee8-b76f-ced1abe3d75d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:12.504870 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4c834de9-4950-4ee8-b76f-ced1abe3d75d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1215 microversion: 2.1 time: 0.088254 May 27 16:37:12.505324 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 545/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:12 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:13.522609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:13.523269 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:13.531214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:13.531673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:13.532457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:13.532971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:13.629133 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:13.636983 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-aa234e8e-a29a-4236-a885-58efa893e62f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1219 microversion: 2.1 time: 0.118840 May 27 16:37:13.637599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 543/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:13 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:13.748540 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:13.749830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:13.758035 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:13.758711 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:13.759693 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:13.760136 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:13.761709 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-78ef5b1c-24a0-4436-9f52-d2e18c9a6540 req-cbcebb12-5f7c-4761-a2bf-25327bf27365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:13.772832 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-78ef5b1c-24a0-4436-9f52-d2e18c9a6540 req-cbcebb12-5f7c-4761-a2bf-25327bf27365 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:13.773220 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-78ef5b1c-24a0-4436-9f52-d2e18c9a6540 req-cbcebb12-5f7c-4761-a2bf-25327bf27365 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:13.784849 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-78ef5b1c-24a0-4436-9f52-d2e18c9a6540 req-cbcebb12-5f7c-4761-a2bf-25327bf27365 service nova] Creating event network-changed:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:37:13.789997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:37:13.790230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-78ef5b1c-24a0-4436-9f52-d2e18c9a6540 req-cbcebb12-5f7c-4761-a2bf-25327bf27365 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 May 27 16:37:13.790941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 544/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:37:14.185588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fba86d29-c84b-4ae1-b0a7-0075e76030a4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 204 len: 0 microversion: 2.1 time: 0.440667 May 27 16:37:14.186232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 546/1090] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:37:13 2022] DELETE /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:37:14.195192 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:14.195898 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:14.203951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:14.204672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:14.205675 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:14.206111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:14.357637 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:14.365725 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9c7d473b-531f-4036-a773-d38f29db2942 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.174583 May 27 16:37:14.366314 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 545/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:14 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:14.654476 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:14.655244 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:14.661760 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:14.669251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:14.669251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:14.669251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:14.731675 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:14.741267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e6ad5f86-7ff4-48d7-a5bc-04613e1c589a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1219 microversion: 2.1 time: 0.091712 May 27 16:37:14.741892 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 547/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:14 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:15.383696 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:15.384347 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:15.391545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:15.392014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:15.392758 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:15.393200 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:15.531762 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:15.539450 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-91c7afb8-a21f-40fe-adba-c5e8a8d34673 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.159656 May 27 16:37:15.540027 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 546/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:15 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:15.759172 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:15.759807 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:15.767367 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:15.767835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:15.768603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:15.769037 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:15.830987 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:15.838739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b8d5587d-0369-46dc-ad16-3901bda4628f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1219 microversion: 2.1 time: 0.083283 May 27 16:37:15.839075 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 548/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:15 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:16.557126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:16.557755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:16.564947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:16.565425 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:16.566234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:16.566631 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:16.722431 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:16.730209 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-db0b8889-6160-472d-a8c4-fbdce6154400 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.177154 May 27 16:37:16.730760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 547/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:16 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:16.856361 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:16.856980 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:16.865278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:16.865761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:16.866537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:16.866978 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:16.933270 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:16.940801 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-df24a0fd-056d-40f9-afcd-d34b6aa4c559 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1211 microversion: 2.1 time: 0.088509 May 27 16:37:16.941379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 549/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:16 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:17.749720 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:17.750618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:17.758536 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:17.758981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:17.760181 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:17.760571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:17.935707 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:17.952495 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-90a359c4-a29e-4eba-a58e-ba4047344f45 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1567 microversion: 2.1 time: 0.208471 May 27 16:37:17.953321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 548/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:17 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:17.957514 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:17.961552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:17.965683 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:17.966215 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:17.967083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:17.967611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:18.043986 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:18.053137 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-59d8f49f-8598-4541-b807-b8edcc647a99 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1267 microversion: 2.1 time: 0.099897 May 27 16:37:18.054298 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 550/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:17 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:18.700005 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-74c863ec-48f7-41d2-a4ed-1b8f3c754c5c req-bfbe9760-7bc9-4317-a25e-b9056d8fc30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046e04ca-1b83-48d8-b713-ca26cce47976", "name": "network-vif-deleted", "tag": "f3fc0271-4978-460d-b0fc-0d84184a59b2"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:18.709429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-74c863ec-48f7-41d2-a4ed-1b8f3c754c5c req-bfbe9760-7bc9-4317-a25e-b9056d8fc30c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:18.709876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-74c863ec-48f7-41d2-a4ed-1b8f3c754c5c req-bfbe9760-7bc9-4317-a25e-b9056d8fc30c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:18.721735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-74c863ec-48f7-41d2-a4ed-1b8f3c754c5c req-bfbe9760-7bc9-4317-a25e-b9056d8fc30c service nova] Creating event network-vif-deleted:f3fc0271-4978-460d-b0fc-0d84184a59b2 for instance 046e04ca-1b83-48d8-b713-ca26cce47976 on hv-cinder-84049 May 27 16:37:18.726803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-74c863ec-48f7-41d2-a4ed-1b8f3c754c5c req-bfbe9760-7bc9-4317-a25e-b9056d8fc30c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 May 27 16:37:18.727645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 549/1099] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:37:18.971628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:18.972961 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:18.980079 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:18.980755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:18.981628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:18.982160 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:19.057743 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:19.067894 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3ff17860-f678-4660-b124-007d0e085ea5 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1218 microversion: 2.1 time: 0.101686 May 27 16:37:19.068526 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 551/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:18 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:19.074343 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:19.075426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:19.084663 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:19.085255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:19.086211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:19.086742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:19.160791 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:19.168526 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-220ea289-9927-4416-b418-3e65ea2f4eb1 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1285 microversion: 2.1 time: 0.099137 May 27 16:37:19.169136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 550/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:19 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:20.088640 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:20.089268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:20.096554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:20.097490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:20.098286 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:20.098730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:20.142365 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:20.143038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:20.143727 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lazy-loading 'fault' on Instance uuid 046e04ca-1b83-48d8-b713-ca26cce47976 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:37:20.186726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:20.187854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:20.188647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672b81726d1445518823f6e7c8887978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57270a9020844e9baf044630fb81bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:20.197000 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-548b4ad4-14f0-423d-898d-a7f43cc9a076 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 200 len: 1223 microversion: 2.1 time: 0.113376 May 27 16:37:20.197720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 552/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:20 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:20.198793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:20.199925 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:20.200797 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:20.201396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:20.349048 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:20.357111 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1923602f-65f8-4afa-8b64-69b2cde50cee tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.174854 May 27 16:37:20.357846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 551/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:20 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:21.063446 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-55c42183-ccd4-4ff2-aec4-73e0957e19a0 req-fc0ec5f5-be93-405a-bf63-8aa2050d4fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8f34a7-dd93-4c1f-b8fd-f45577c3c349", "tag": "a1005081-804f-4ca4-a8e7-1f82d715a926"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:21.074771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-55c42183-ccd4-4ff2-aec4-73e0957e19a0 req-fc0ec5f5-be93-405a-bf63-8aa2050d4fc6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:21.075972 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-55c42183-ccd4-4ff2-aec4-73e0957e19a0 req-fc0ec5f5-be93-405a-bf63-8aa2050d4fc6 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:21.097258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-55c42183-ccd4-4ff2-aec4-73e0957e19a0 req-fc0ec5f5-be93-405a-bf63-8aa2050d4fc6 service nova] Creating event network-changed:a1005081-804f-4ca4-a8e7-1f82d715a926 for instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 on hv-cinder-84049 May 27 16:37:21.108073 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-55c42183-ccd4-4ff2-aec4-73e0957e19a0 req-fc0ec5f5-be93-405a-bf63-8aa2050d4fc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055399 May 27 16:37:21.115509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 553/1104] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:37:21.218488 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:21.220006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] [instance: 046e04ca-1b83-48d8-b713-ca26cce47976] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:21.229673 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:21.230385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:21.233879 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:21.234561 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:21.256607 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] HTTP exception thrown: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Request method failure captured: May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 HTTP/1.1 May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikPz7C9Ve2Osh-mKsz9w4-q8W2xyvC86OQkSK_JvZkBvk3HFeEdQm_o3up6mNWYvrlVdJ5K0Ar8CuQ29Uw7y5hJzla9zw9PrUCuN0P9pEVN9mtt2kGwIyT_y1DDQtZK0b32Yzl5EUIGxoGiG1y_nyUUlqfFSobV_sGJ3IymazxYuJ2Mc May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: e57270a9020844e9baf044630fb81bcd May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-TestShelveInstance-1724130474 May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:37:21.258687 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e57270a9020844e9baf044630fb81bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e57270a9020844e9baf044630fb81bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e57270a9020844e9baf044630fb81bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e57270a9020844e9baf044630fb81bcd", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-TestShelveInstance-1724130474 May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: e57270a9020844e9baf044630fb81bcd May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-TestShelveInstance-1724130474 May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-TestShelveInstance-1724130474-project May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: 672b81726d1445518823f6e7c8887978 May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-TestShelveInstance-1724130474-project May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. May 27 16:37:21.260134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '046e04ca-1b83-48d8-b713-ca26cce47976'} May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:37:21.261213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. May 27 16:37:21.262995 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:21.264738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Returning 404 to user: Instance 046e04ca-1b83-48d8-b713-ca26cce47976 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:37:21.264738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7728a014-bea0-4119-884d-e1ac59488282 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976" status: 404 len: 111 microversion: 2.1 time: 0.047849 May 27 16:37:21.264738 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 552/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:21 2022] GET /compute/v2.1/servers/046e04ca-1b83-48d8-b713-ca26cce47976 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:37:21.379673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:21.380368 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:21.382332 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:21.387631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:21.388076 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:21.409380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:21.409380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:21.530827 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:21.539484 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ffe33480-96cb-488e-bd79-4158299537d7 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.164134 May 27 16:37:21.540360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 554/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:21 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:21.684661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-76cba938-7b22-41e4-90b2-aac473d44ba4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] Calling method '.version_select at 0x7f0e9960c4c0>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:21.692070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:21.798454 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-76cba938-7b22-41e4-90b2-aac473d44ba4 tempest-TestShelveInstance-1724130474 tempest-TestShelveInstance-1724130474-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-310070568" status: 202 len: 0 microversion: 2.1 time: 0.117554 May 27 16:37:21.799320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 553/1107] 10.222.0.42 () {58 vars in 1250 bytes} [Fri May 27 16:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-310070568 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:37:22.560237 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:22.561442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:22.565415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=8 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:22.571712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:22.575423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:22.575423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:22.575423 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:22.816848 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:22.825252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-33190a90-06c4-4ee8-b83b-a00c484cabd3 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.271175 May 27 16:37:22.825970 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 555/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:22 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:23.847666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:23.849261 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:23.861621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:23.866473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:23.866473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:23.866473 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:24.176221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:24.176221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c038ef7c-be77-4770-bc9a-833e20600287 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.312442 May 27 16:37:24.176221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 554/1109] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:23 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:25.192495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:25.193220 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:25.200383 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:25.200923 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:25.201786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:25.202831 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:25.356748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:25.367363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5d3f1e9d-ed1d-4e07-9557-1fe4572b3c1a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.178939 May 27 16:37:25.378190 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 556/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:25 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:26.386742 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:26.387340 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:26.396978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:26.397360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:26.401122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:26.406273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:26.565320 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:26.575487 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-541ef1c9-512f-43f4-8619-1a848e946a4f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.190605 May 27 16:37:26.584530 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 555/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:26 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:27.591251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:27.591863 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:27.610382 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:27.611124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:27.612112 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:27.612786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:27.945861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:27.975418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-db14ea1e-f130-43bb-81a6-cb55fc49a40f tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.371472 May 27 16:37:27.975418 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 557/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:27 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:28.063644 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-07bde7ca-daf2-465d-a51d-19f91a993358 req-c7c38539-9243-4ccf-ad39-4315618422a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8f34a7-dd93-4c1f-b8fd-f45577c3c349", "name": "network-vif-plugged", "status": "completed", "tag": "a1005081-804f-4ca4-a8e7-1f82d715a926"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:28.076004 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-07bde7ca-daf2-465d-a51d-19f91a993358 req-c7c38539-9243-4ccf-ad39-4315618422a8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:28.076555 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-07bde7ca-daf2-465d-a51d-19f91a993358 req-c7c38539-9243-4ccf-ad39-4315618422a8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:28.097254 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-07bde7ca-daf2-465d-a51d-19f91a993358 req-c7c38539-9243-4ccf-ad39-4315618422a8 service nova] Creating event network-vif-plugged:a1005081-804f-4ca4-a8e7-1f82d715a926 for instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 on hv-cinder-84049 May 27 16:37:28.105648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-07bde7ca-daf2-465d-a51d-19f91a993358 req-c7c38539-9243-4ccf-ad39-4315618422a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046784 May 27 16:37:28.107116 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 556/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:37:28.987734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:28.988824 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:29.009726 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:29.016737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:29.016737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:29.018917 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:29.295217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:29.295217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-94fd1ffe-aa86-452d-af01-57f4eede069d tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1315 microversion: 2.1 time: 0.311822 May 27 16:37:29.295217 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 558/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:28 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:30.309234 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:30.316069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:30.340391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:30.340846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:30.341648 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:30.342392 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:30.601744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:30.616074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-eee94bf1-3d73-4cb8-8c77-33fd0dc1aded tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1465 microversion: 2.1 time: 0.309483 May 27 16:37:30.629191 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 557/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:30 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1465 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:30.665542 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:30.666131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:30.675207 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:30.675733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:30.676745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:30.677252 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:30.711586 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:37:30.743086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:31.081213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ccf06635-6c49-411c-81ee-fdf0b2f68b79 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 204 len: 0 microversion: 2.1 time: 0.413991 May 27 16:37:31.081213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 559/1116] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:37:30 2022] DELETE /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:37:31.087430 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:31.087864 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:31.097016 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:31.097502 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:31.098274 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:31.098759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:31.288669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:31.297923 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ebdeec12-0920-4c64-92f1-173d752e9da8 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1471 microversion: 2.1 time: 0.214906 May 27 16:37:31.298822 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 558/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:31 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:32.316629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:32.317325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:32.324628 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:32.325082 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:32.325874 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:32.326380 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:32.462937 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:32.471148 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2ff5004e-4f55-4949-82db-0d286869e70b tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1471 microversion: 2.1 time: 0.158791 May 27 16:37:32.471716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 560/1118] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:32 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:33.488963 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:33.490654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:33.496321 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:33.496815 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:33.497626 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:33.498319 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:33.646833 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:33.654557 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-10d3df68-8c69-42b8-a26b-57ddbf8d2192 tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1471 microversion: 2.1 time: 0.169663 May 27 16:37:33.655222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:33 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:34.673406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:34.674021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:34.680958 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:34.681442 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:34.682209 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:34.682647 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:34.816191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:34.823819 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-65c9f472-9213-494c-902c-24dea0c563aa tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1471 microversion: 2.1 time: 0.155667 May 27 16:37:34.824390 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 561/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:34 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:35.305597 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-936dbfbc-74f1-4ba4-86e2-a25e7e99d6ea req-fded39c7-0397-457f-85a8-f2f54447173c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8f34a7-dd93-4c1f-b8fd-f45577c3c349", "name": "network-vif-deleted", "tag": "a1005081-804f-4ca4-a8e7-1f82d715a926"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:35.316190 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-936dbfbc-74f1-4ba4-86e2-a25e7e99d6ea req-fded39c7-0397-457f-85a8-f2f54447173c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:35.316726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-936dbfbc-74f1-4ba4-86e2-a25e7e99d6ea req-fded39c7-0397-457f-85a8-f2f54447173c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:35.329448 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-936dbfbc-74f1-4ba4-86e2-a25e7e99d6ea req-fded39c7-0397-457f-85a8-f2f54447173c service nova] Creating event network-vif-deleted:a1005081-804f-4ca4-a8e7-1f82d715a926 for instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 on hv-cinder-84049 May 27 16:37:35.336230 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-936dbfbc-74f1-4ba4-86e2-a25e7e99d6ea req-fded39c7-0397-457f-85a8-f2f54447173c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034274 May 27 16:37:35.336948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 560/1121] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:37:35.841331 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:35.842040 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:35.849867 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:35.850329 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:35.851161 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:35.851602 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:35.884375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:35.884823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:35.885363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lazy-loading 'fault' on Instance uuid ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:37:35.927491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5541cb2c684bf1850140fa3d766955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bb35ed1e9440dbb0fe8bb80feb3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:35.935244 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6d81953a-57c1-4d72-8d20-45ce813825ae tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 200 len: 1305 microversion: 2.1 time: 0.097888 May 27 16:37:35.935827 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 562/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:35 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:36.953195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:36.954375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] [instance: ed8f34a7-dd93-4c1f-b8fd-f45577c3c349] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:36.960661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:36.961115 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:36.962064 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:36.962554 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:36.979514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] HTTP exception thrown: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Request method failure captured: May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 HTTP/1.1 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP4zqdq3GUe8aljHPekpGXgM28ErKkqndu-IobqGHXUyN27RvzNkRJAKpSrKD4zHamGlJ9GB2b8Ni3h6uCmRHRLHBxQAp5DD9rTZFoQW8WrvdFZmJW61guW6_psmOOgElRhvuCZrdpehgl1Y1wAY2GIK78x5_D8p18mW_JFe8qJS7bE May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: f8bb35ed1e9440dbb0fe8bb80feb3982 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesNegativeTest-1202709679 May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:37:36.981267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8bb35ed1e9440dbb0fe8bb80feb3982"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f8bb35ed1e9440dbb0fe8bb80feb3982"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8bb35ed1e9440dbb0fe8bb80feb3982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f8bb35ed1e9440dbb0fe8bb80feb3982", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesNegativeTest-1202709679 May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: f8bb35ed1e9440dbb0fe8bb80feb3982 May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesNegativeTest-1202709679 May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesNegativeTest-1202709679-project May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: ac5541cb2c684bf1850140fa3d766955 May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesNegativeTest-1202709679-project May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. May 27 16:37:36.982974 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'ed8f34a7-dd93-4c1f-b8fd-f45577c3c349'} May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:37:36.983897 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. May 27 16:37:36.986214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:37:36.987621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] Returning 404 to user: Instance ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:37:36.987621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-65275f96-1964-4311-b78f-7fa533f72c6a tempest-VolumesNegativeTest-1202709679 tempest-VolumesNegativeTest-1202709679-project] 10.222.0.42 "GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349" status: 404 len: 111 microversion: 2.1 time: 0.034325 May 27 16:37:36.987621 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:36 2022] GET /compute/v2.1/servers/ed8f34a7-dd93-4c1f-b8fd-f45577c3c349 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:37:49.654797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-69685180", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "networks": [{"uuid": "b60fcfa9-e3bb-408f-8325-7dd843d7622c"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:49.662515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:49.663185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:49.710125 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] validate_networks() for [('b60fcfa9-e3bb-408f-8325-7dd843d7622c', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:37:50.064662 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:37:50.065197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:37:50.065702 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:37:50.066152 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:37:50.076379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:37:50.076379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:50.076379 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:50.076786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:50.076914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:50.094302 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Getting quotas for project f4b5ddb45f284ece84c7a94eb95a11c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:37:50.099060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Getting quotas for user c946427352794703a848399e29f524b6 and project f4b5ddb45f284ece84c7a94eb95a11c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:37:50.110188 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:37:50.113668 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:37:50.255522 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ff689f23-c398-4f67-bdfa-495fcd35143a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604715 May 27 16:37:50.256173 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 563/1124] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:37:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:37:50.266359 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-189f4e89-6ebc-4c3f-994f-5d00c45619a9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:50.267001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-189f4e89-6ebc-4c3f-994f-5d00c45619a9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:50.269727 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:50.270417 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=84 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:50.324306 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-189f4e89-6ebc-4c3f-994f-5d00c45619a9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:50.332635 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-189f4e89-6ebc-4c3f-994f-5d00c45619a9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1217 microversion: 2.1 time: 0.070375 May 27 16:37:50.333195 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:50 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:51.351153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b8eaa362-6f5f-4478-83b7-37cf8dd321ed tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:51.351778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b8eaa362-6f5f-4478-83b7-37cf8dd321ed tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:51.414684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b8eaa362-6f5f-4478-83b7-37cf8dd321ed tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:51.421601 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b8eaa362-6f5f-4478-83b7-37cf8dd321ed tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1217 microversion: 2.1 time: 0.075416 May 27 16:37:51.422180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 564/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:51 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:52.440239 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9a4b07cf-d481-40b1-8f11-f4cbee8048e9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:52.440966 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9a4b07cf-d481-40b1-8f11-f4cbee8048e9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:52.503013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9a4b07cf-d481-40b1-8f11-f4cbee8048e9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:52.510979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9a4b07cf-d481-40b1-8f11-f4cbee8048e9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1217 microversion: 2.1 time: 0.075582 May 27 16:37:52.513376 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 563/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:52 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:53.528306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-67126d51-faed-417e-9b94-06cd9160c994 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:53.528927 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-67126d51-faed-417e-9b94-06cd9160c994 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:53.584432 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-67126d51-faed-417e-9b94-06cd9160c994 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:53.597055 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-67126d51-faed-417e-9b94-06cd9160c994 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1217 microversion: 2.1 time: 0.072725 May 27 16:37:53.597671 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 565/1128] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:53 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:54.614375 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:54.617431 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:54.621632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:54.622104 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:54.623137 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:54.623574 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:54.691413 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:54.698444 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-683ef179-c870-48d5-adb1-8d511a90e9f2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1221 microversion: 2.1 time: 0.088471 May 27 16:37:54.704373 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 564/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:54 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:55.716189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:55.716842 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:55.724101 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:55.724547 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:55.725313 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:55.725778 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:55.799537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:55.811385 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-26f37010-4c50-4fbf-bfe8-0db2b0e4c1b3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1221 microversion: 2.1 time: 0.099005 May 27 16:37:55.821132 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 566/1130] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:55 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:37:56.828632 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:56.829962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:56.836987 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:56.837457 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:56.838224 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:56.838658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:56.902176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:56.910485 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d17bba9d-0533-4993-9be7-908dd30b20f0 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1269 microversion: 2.1 time: 0.085629 May 27 16:37:56.911090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 565/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:56 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:57.929064 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:57.929865 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:57.936844 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:57.937297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:57.938109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:57.938858 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:58.077478 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:58.085871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c324e90d-22a7-49b4-bed5-8bff0d5173b2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.160993 May 27 16:37:58.088770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 567/1132] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:57 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:37:58.894854 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-75b3d096-46f7-4949-a3dc-c87235255569 req-a909f8ec-dcb7-4de2-8dde-a710257b109a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc150a41-2ba3-47b6-804d-b37d9179df08", "tag": "f78811fc-2053-4490-aa83-93ad6e5f74f5"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:37:58.903962 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-75b3d096-46f7-4949-a3dc-c87235255569 req-a909f8ec-dcb7-4de2-8dde-a710257b109a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:58.904396 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-75b3d096-46f7-4949-a3dc-c87235255569 req-a909f8ec-dcb7-4de2-8dde-a710257b109a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:58.916992 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-75b3d096-46f7-4949-a3dc-c87235255569 req-a909f8ec-dcb7-4de2-8dde-a710257b109a service nova] Creating event network-changed:f78811fc-2053-4490-aa83-93ad6e5f74f5 for instance bc150a41-2ba3-47b6-804d-b37d9179df08 on hv-cinder-84049 May 27 16:37:58.921900 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-75b3d096-46f7-4949-a3dc-c87235255569 req-a909f8ec-dcb7-4de2-8dde-a710257b109a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 May 27 16:37:58.922644 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 566/1133] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:37:59.110234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:37:59.112047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:37:59.119402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:59.119850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:59.120619 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:37:59.121047 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:37:59.256202 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:37:59.263434 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5c955837-163b-445c-a6d9-f84c925029c9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.157045 May 27 16:37:59.264010 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 568/1134] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:37:59 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:00.281144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:00.281785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:00.288921 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:00.289386 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:00.290148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:00.290606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:00.423619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:00.431057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-443cfc7e-5181-4552-b7a9-1c976f93112e tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.154230 May 27 16:38:00.431628 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 567/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:00 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:01.448803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:01.449439 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:01.451301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:01.457556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:01.463652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:01.463652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:01.463652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:01.603775 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:01.611508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a2c4c72d-6df7-4189-9530-0a3db708f4b9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.166465 May 27 16:38:01.612169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:01 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:02.628871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:02.629548 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:02.632069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=4 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:02.637008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:02.637495 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:02.638285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:02.638753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:02.779366 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:02.789674 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1d5f4490-cfc8-42e1-9f00-a99065ce2ca5 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.165089 May 27 16:38:02.790162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 568/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:02 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:03.807182 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:03.807797 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:03.810115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:03.815033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:03.816525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:03.816525 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:03.816720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:03.950463 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:03.958605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-975dce27-7e35-498e-aa77-4b86879b8da9 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.155378 May 27 16:38:03.959179 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 570/1138] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:03 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:04.197333 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-af91826c-5fc5-48b5-a657-e88b67293fc3 req-b4ba7bd4-a826-43d9-b251-7366db9b7596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc150a41-2ba3-47b6-804d-b37d9179df08", "name": "network-vif-plugged", "status": "completed", "tag": "f78811fc-2053-4490-aa83-93ad6e5f74f5"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:38:04.206765 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-af91826c-5fc5-48b5-a657-e88b67293fc3 req-b4ba7bd4-a826-43d9-b251-7366db9b7596 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:04.207362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-af91826c-5fc5-48b5-a657-e88b67293fc3 req-b4ba7bd4-a826-43d9-b251-7366db9b7596 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:04.218470 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-af91826c-5fc5-48b5-a657-e88b67293fc3 req-b4ba7bd4-a826-43d9-b251-7366db9b7596 service nova] Creating event network-vif-plugged:f78811fc-2053-4490-aa83-93ad6e5f74f5 for instance bc150a41-2ba3-47b6-804d-b37d9179df08 on hv-cinder-84049 May 27 16:38:04.224211 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-af91826c-5fc5-48b5-a657-e88b67293fc3 req-b4ba7bd4-a826-43d9-b251-7366db9b7596 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 May 27 16:38:04.224803 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 569/1139] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:38:04.975545 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:04.991310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:04.991310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:04.991310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:04.991310 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:04.991733 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:05.115737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:05.123490 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0c257f63-416e-4e8d-82a1-351c9b248cf4 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.151765 May 27 16:38:05.124059 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:04 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:06.143429 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:06.144123 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:06.150512 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:06.150955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:06.151715 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:06.152151 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:06.291904 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:06.299881 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1a2bba00-406f-4f19-933d-de69940c812d tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1317 microversion: 2.1 time: 0.161988 May 27 16:38:06.300456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 570/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:06 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:07.318375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:07.318936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:07.325160 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:07.325653 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:07.326427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:07.326879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:07.457128 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:07.464783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0d8986e4-bdca-4736-b2c2-87bfe57c3102 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1506 microversion: 2.1 time: 0.151565 May 27 16:38:07.465373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 572/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:07 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:23.990984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a072a3b3-dc75-403f-b8d7-37d6e86e4993", "device": "/dev/sdb"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:38:23.992549 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:23.995332 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=22 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:23.996003 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=34 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:24.001333 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:24.001800 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:24.002560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:24.003013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:24.875950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fbf24870-36fe-4de5-a3bb-24e035dfa485 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "POST /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889704 May 27 16:38:24.876583 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 571/1143] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:38:23 2022] POST /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:38:50.684806 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:50.685360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:50.687382 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:50.688038 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=44 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:50.692751 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:50.693201 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:50.693995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:50.694431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:50.976321 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lazy-loading 'services' on Instance uuid bc150a41-2ba3-47b6-804d-b37d9179df08 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:38:51.156396 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-e0845d01-05f8-4a81-b5a2-ec6c5466a184 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08/os-volume_attachments/a072a3b3-dc75-403f-b8d7-37d6e86e4993" status: 202 len: 0 microversion: 2.1 time: 0.475616 May 27 16:38:51.157169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:38:50 2022] DELETE /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08/os-volume_attachments/a072a3b3-dc75-403f-b8d7-37d6e86e4993 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:38:52.272772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:52.276229 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:52.278341 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:52.278916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:52.285510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:52.285956 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:52.286723 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:52.287159 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:52.312868 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:38:52.683400 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-8b46c0bf-56a3-4578-8805-0995b3f50bea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 204 len: 0 microversion: 2.1 time: 0.411827 May 27 16:38:52.684000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 572/1145] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:38:52 2022] DELETE /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:38:52.692977 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:52.694366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:52.703469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:52.704034 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:52.704960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:52.705623 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:52.836935 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:52.844884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c2ede683-9a18-4eef-85d7-4267d79e5166 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1512 microversion: 2.1 time: 0.156204 May 27 16:38:52.845469 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 574/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:52 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:53.863094 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:53.863784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:53.870653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:53.871087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:53.872076 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:53.872509 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:54.109385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:54.116950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-2cffd1e2-d1fe-44bb-bcae-f98d29876c0a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1512 microversion: 2.1 time: 0.258037 May 27 16:38:54.117485 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 573/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:53 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:55.136010 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:55.136572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:55.143715 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:55.144284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:55.146208 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:55.146997 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:55.281231 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:55.291165 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-98689cb2-63a7-4d9e-86b4-940042578c19 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1512 microversion: 2.1 time: 0.159992 May 27 16:38:55.291786 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:55 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:38:55.379882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-f43d0301-e98f-4e9a-a43f-e57ff3fdb0a6 req-51a2127e-4282-413a-ba59-b8157849c939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc150a41-2ba3-47b6-804d-b37d9179df08", "name": "network-vif-deleted", "tag": "f78811fc-2053-4490-aa83-93ad6e5f74f5"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:38:55.390405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-f43d0301-e98f-4e9a-a43f-e57ff3fdb0a6 req-51a2127e-4282-413a-ba59-b8157849c939 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:55.390783 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-f43d0301-e98f-4e9a-a43f-e57ff3fdb0a6 req-51a2127e-4282-413a-ba59-b8157849c939 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:55.402877 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-f43d0301-e98f-4e9a-a43f-e57ff3fdb0a6 req-51a2127e-4282-413a-ba59-b8157849c939 service nova] Creating event network-vif-deleted:f78811fc-2053-4490-aa83-93ad6e5f74f5 for instance bc150a41-2ba3-47b6-804d-b37d9179df08 on hv-cinder-84049 May 27 16:38:55.407980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-f43d0301-e98f-4e9a-a43f-e57ff3fdb0a6 req-51a2127e-4282-413a-ba59-b8157849c939 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032067 May 27 16:38:55.408599 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 574/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:38:56.308618 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:56.309232 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:56.315895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:56.318251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:56.318251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:56.318251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:56.351194 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:56.351646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:56.352287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lazy-loading 'fault' on Instance uuid bc150a41-2ba3-47b6-804d-b37d9179df08 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:38:56.395862 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:38:56.400629 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:38:56.400875 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 (ip 10.222.0.42) !!! May 27 16:38:56.405502 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8a599773-dceb-40bf-a911-fd73b27047ea tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 200 len: 1307 microversion: 2.1 time: 0.101284 May 27 16:38:56.413488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 576/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:56 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:38:57.424446 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:38:57.425147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: bc150a41-2ba3-47b6-804d-b37d9179df08] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:38:57.431669 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:57.432123 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:57.432876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:38:57.433312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:38:57.447006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] HTTP exception thrown: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Request method failure captured: May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 HTTP/1.1 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP5af0lXKqrxYbYg5adyjyKfaA1Hvdfy35LVeSknVrZNtSf3Rj41MunxmRb0Bn_rBsXdhhldbjRnqDa5tlBP0mlQmEOU6dJ4yPV90MIRaXHBpprRyxrjt8McKJMv-6rJjHt2mVuvdN8hD1ieJVrcRk0Wzv0LAW-fJb3Qmv7dZ60zA64 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: f4b5ddb45f284ece84c7a94eb95a11c1 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:38:57.448645 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4b5ddb45f284ece84c7a94eb95a11c1", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: f4b5ddb45f284ece84c7a94eb95a11c1 May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesSnapshotTestJSON-509137468-project May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: c946427352794703a848399e29f524b6 May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesSnapshotTestJSON-509137468-project May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. May 27 16:38:57.450664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': 'bc150a41-2ba3-47b6-804d-b37d9179df08'} May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:38:57.451843 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. May 27 16:38:57.453564 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:38:57.455007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Returning 404 to user: Instance bc150a41-2ba3-47b6-804d-b37d9179df08 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:38:57.455007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ab9c0e78-0584-41d6-927a-6526dc4a1781 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08" status: 404 len: 111 microversion: 2.1 time: 0.030432 May 27 16:38:57.455007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 575/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:38:57 2022] GET /compute/v2.1/servers/bc150a41-2ba3-47b6-804d-b37d9179df08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:39:08.001757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1388409093", "imageRef": "523f4e30-b6e2-4c43-8b75-5361c6ea0e29", "flavorRef": "452", "networks": [{"uuid": "b60fcfa9-e3bb-408f-8325-7dd843d7622c"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:39:08.009225 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:08.009903 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:08.056562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] validate_networks() for [('b60fcfa9-e3bb-408f-8325-7dd843d7622c', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:39:08.456236 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:39:08.456662 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:39:08.457140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:39:08.457590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:39:08.457979 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:39:08.467257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:08.467706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:08.468501 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:08.468943 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:08.486705 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Getting quotas for project f4b5ddb45f284ece84c7a94eb95a11c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:39:08.490346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Getting quotas for user c946427352794703a848399e29f524b6 and project f4b5ddb45f284ece84c7a94eb95a11c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:39:08.502369 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:39:08.504631 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='523f4e30-b6e2-4c43-8b75-5361c6ea0e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:39:08.638147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6a6d456c-55d4-43ba-bd82-c4643357d685 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640195 May 27 16:39:08.638872 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 577/1152] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 16:39:08.649592 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-c17fd0ed-54d1-4c45-9acd-180e81647d76 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:08.650206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-c17fd0ed-54d1-4c45-9acd-180e81647d76 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:08.652560 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:08.653221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:08.706890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-c17fd0ed-54d1-4c45-9acd-180e81647d76 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:08.714545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-c17fd0ed-54d1-4c45-9acd-180e81647d76 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1219 microversion: 2.1 time: 0.069437 May 27 16:39:08.715124 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 576/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:08 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:09.733287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:09.733924 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:09.740295 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:09.740796 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:09.741593 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:09.742026 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:09.804050 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:09.812353 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-4a15531a-ea8d-4614-8e33-698d72a1f432 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1223 microversion: 2.1 time: 0.083541 May 27 16:39:09.812920 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 578/1154] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:09 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:39:10.830638 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:10.831168 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:10.840462 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:10.840909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:10.841719 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:10.842146 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:10.905905 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:10.913428 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-56983286-1950-4854-b626-6f4c9d095fd3 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1279 microversion: 2.1 time: 0.087017 May 27 16:39:10.914706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:10 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:11.935106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:11.935706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:11.942541 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:11.943005 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:11.943894 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:11.944374 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:12.089145 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:12.096722 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3dd16bf0-78ec-4eeb-861c-cdcefbafec09 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.166938 May 27 16:39:12.097452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 579/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:11 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:12.634279 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-bf8038e5-5b20-4ca3-a08f-d8c58495435a req-69b837c1-476f-41a5-9983-9d05c64611c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c1f945-2ab3-44e3-9191-e88c99cd5cd5", "tag": "ce797343-5c0f-4617-9363-1bbde60ed4d6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:39:12.643390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bf8038e5-5b20-4ca3-a08f-d8c58495435a req-69b837c1-476f-41a5-9983-9d05c64611c7 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:12.643824 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-bf8038e5-5b20-4ca3-a08f-d8c58495435a req-69b837c1-476f-41a5-9983-9d05c64611c7 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:12.660130 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-bf8038e5-5b20-4ca3-a08f-d8c58495435a req-69b837c1-476f-41a5-9983-9d05c64611c7 service nova] Creating event network-changed:ce797343-5c0f-4617-9363-1bbde60ed4d6 for instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 on hv-cinder-84049 May 27 16:39:12.664915 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-bf8038e5-5b20-4ca3-a08f-d8c58495435a req-69b837c1-476f-41a5-9983-9d05c64611c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103588 May 27 16:39:12.666214 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 578/1157] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:39:13.115415 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:13.116080 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:13.124745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:13.125235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:13.126140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:13.126655 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:13.265472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:13.273135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-10d21c79-f2e3-41c5-9c6f-b3251b3c79ac tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.162099 May 27 16:39:13.274243 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 580/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:13 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:14.292149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:14.292909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:14.299140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:14.299588 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:14.300351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:14.300786 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:14.434357 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:14.441951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-6e5314e6-87fe-4218-b127-ebf0e8502126 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.154990 May 27 16:39:14.442520 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:14 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:15.459680 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:15.460251 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:15.466850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:15.467493 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:15.468248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:15.468682 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:15.594756 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:15.602263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1fbc060c-866c-48df-95cf-2ef231900693 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.146363 May 27 16:39:15.602828 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 581/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:15 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:16.619877 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:16.620513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:16.627711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:16.627961 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:16.628727 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:16.629162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:16.759573 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:16.767077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-83f49f70-f39a-41f9-ae63-d789cde87567 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.151331 May 27 16:39:16.767646 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 580/1161] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:16 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:17.785592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:17.786204 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:17.793603 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:17.794052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:17.794825 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:17.795268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:17.944110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:17.952497 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-eabbc955-f476-409d-9d05-7ae15d5366fe tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.170836 May 27 16:39:17.953078 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 582/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:17 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:18.567857 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-8c6285ac-e8af-4825-9b18-472cc905c32b req-3619cfcf-4252-4bd7-9f6d-3400ea55423a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c1f945-2ab3-44e3-9191-e88c99cd5cd5", "name": "network-vif-plugged", "status": "completed", "tag": "ce797343-5c0f-4617-9363-1bbde60ed4d6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:39:18.579484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8c6285ac-e8af-4825-9b18-472cc905c32b req-3619cfcf-4252-4bd7-9f6d-3400ea55423a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:18.579932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-8c6285ac-e8af-4825-9b18-472cc905c32b req-3619cfcf-4252-4bd7-9f6d-3400ea55423a service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:18.596659 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-8c6285ac-e8af-4825-9b18-472cc905c32b req-3619cfcf-4252-4bd7-9f6d-3400ea55423a service nova] Creating event network-vif-plugged:ce797343-5c0f-4617-9363-1bbde60ed4d6 for instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 on hv-cinder-84049 May 27 16:39:18.601862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-8c6285ac-e8af-4825-9b18-472cc905c32b req-3619cfcf-4252-4bd7-9f6d-3400ea55423a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037791 May 27 16:39:18.602588 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 581/1163] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:39:18.970261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:18.970879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:18.972744 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:18.973427 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:18.979373 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:18.982656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:18.982656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:18.982656 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:19.115097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:19.125465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b9cd81ba-bef1-4847-ade3-59bf1a09c876 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.156590 May 27 16:39:19.125465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 583/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:18 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:20.137084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:20.141704 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:20.142403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:20.148667 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:20.149112 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:20.149906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:20.150395 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:20.286535 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:20.294663 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f45b1170-a409-4525-9cb2-d1f638d447ce tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1319 microversion: 2.1 time: 0.158561 May 27 16:39:20.295233 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 582/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:20 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:21.312117 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:21.312646 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:21.319321 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:21.319771 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:21.320630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:21.321781 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:21.466544 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:21.474221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-8f917183-031d-45c0-a636-90df9028d136 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1508 microversion: 2.1 time: 0.166032 May 27 16:39:21.474794 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 584/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:21 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:21.490419 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a0c2f81-cc03-4204-8dfb-56e77d6ad0df", "device": "/dev/sdb"}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:39:21.491569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:21.499385 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:21.499833 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:21.500603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:21.501038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:22.446651 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-100a085b-1116-418d-ae5a-5910ac1895a2 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "POST /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959383 May 27 16:39:22.447565 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 583/1167] 10.222.0.42 () {60 vars in 1322 bytes} [Fri May 27 16:39:21 2022] POST /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:39:42.390279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:42.390914 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:42.393370 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:42.394041 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=44 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:42.399136 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:42.399700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:42.400511 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:42.400950 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:42.484652 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lazy-loading 'services' on Instance uuid 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:39:42.743776 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-79d0f356-37c9-4d1e-ad4b-1a1c5ffd132c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5/os-volume_attachments/4a0c2f81-cc03-4204-8dfb-56e77d6ad0df" status: 202 len: 0 microversion: 2.1 time: 0.357998 May 27 16:39:42.744521 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 585/1168] 10.222.0.42 () {58 vars in 1415 bytes} [Fri May 27 16:39:42 2022] DELETE /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5/os-volume_attachments/4a0c2f81-cc03-4204-8dfb-56e77d6ad0df => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:39:44.914655 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:44.915552 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:44.919909 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=18 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:44.921733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:44.927326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:44.930196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:44.930196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:44.930196 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:44.956392 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:39:45.236806 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a8960aab-7f44-47b5-af16-beab251c007b tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 204 len: 0 microversion: 2.1 time: 0.325768 May 27 16:39:45.237467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 584/1169] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:39:44 2022] DELETE /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 16:39:45.248516 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:45.249503 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:45.256562 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:45.257015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:45.257827 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:45.258267 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:45.403188 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:45.412877 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-336a3e7d-6a39-496e-ba66-de3b6e2bdd24 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1514 microversion: 2.1 time: 0.169979 May 27 16:39:45.413505 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 586/1170] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:45 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:46.431308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:46.432006 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:46.439024 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:46.439468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:46.440219 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:46.440651 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:46.571077 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:46.579222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dd103adb-cf00-4516-be6e-d1df7089e94c tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1514 microversion: 2.1 time: 0.152053 May 27 16:39:46.579788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 585/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:46 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:47.597322 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:47.598139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:47.604150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:47.609441 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:47.609441 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:47.609441 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:47.671272 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:47.677855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0be04a25-a12f-4b2e-89a1-09f15cfdfce8 tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1472 microversion: 2.1 time: 0.084328 May 27 16:39:47.678431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 587/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:47 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:47.693221 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-c9dff3b3-5e68-45d5-856f-829bae022044 req-e1e02318-32ce-4f40-bead-44e22321b9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c1f945-2ab3-44e3-9191-e88c99cd5cd5", "name": "network-vif-deleted", "tag": "ce797343-5c0f-4617-9363-1bbde60ed4d6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:39:47.702730 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c9dff3b3-5e68-45d5-856f-829bae022044 req-e1e02318-32ce-4f40-bead-44e22321b9f8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:47.703178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c9dff3b3-5e68-45d5-856f-829bae022044 req-e1e02318-32ce-4f40-bead-44e22321b9f8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:47.714160 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-c9dff3b3-5e68-45d5-856f-829bae022044 req-e1e02318-32ce-4f40-bead-44e22321b9f8 service nova] Creating event network-vif-deleted:ce797343-5c0f-4617-9363-1bbde60ed4d6 for instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 on hv-cinder-84049 May 27 16:39:47.720015 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-c9dff3b3-5e68-45d5-856f-829bae022044 req-e1e02318-32ce-4f40-bead-44e22321b9f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030371 May 27 16:39:47.720615 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 586/1173] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:39:48.695339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:48.695944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:48.702467 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:48.702906 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:48.703659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:48.704087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:48.736571 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:48.737012 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:48.737491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lazy-loading 'fault' on Instance uuid 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:39:48.777048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c946427352794703a848399e29f524b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ddb45f284ece84c7a94eb95a11c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:39:48.785261 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fe0bdc6f-f6d8-4a67-b087-591078be80db tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 200 len: 1309 microversion: 2.1 time: 0.093807 May 27 16:39:48.785860 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 588/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:48 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:39:49.806654 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:39:49.807360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] [instance: 75c1f945-2ab3-44e3-9191-e88c99cd5cd5] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:39:49.814330 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:49.814779 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:49.815544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:39:49.815981 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:39:49.829866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] HTTP exception thrown: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Request method failure captured: May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 HTTP/1.1 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP5af0lXKqrxYbYg5adyjyKfaA1Hvdfy35LVeSknVrZNtSf3Rj41MunxmRb0Bn_rBsXdhhldbjRnqDa5tlBP0mlQmEOU6dJ4yPV90MIRaXHBpprRyxrjt8McKJMv-6rJjHt2mVuvdN8hD1ieJVrcRk0Wzv0LAW-fJb3Qmv7dZ60zA64 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: f4b5ddb45f284ece84c7a94eb95a11c1 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:39:49.831489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b5ddb45f284ece84c7a94eb95a11c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4b5ddb45f284ece84c7a94eb95a11c1", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: f4b5ddb45f284ece84c7a94eb95a11c1 May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-509137468 May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-VolumesSnapshotTestJSON-509137468-project May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: c946427352794703a848399e29f524b6 May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-VolumesSnapshotTestJSON-509137468-project May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. May 27 16:39:49.835756 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '75c1f945-2ab3-44e3-9191-e88c99cd5cd5'} May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:39:49.836596 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. May 27 16:39:49.838309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:39:49.839755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] Returning 404 to user: Instance 75c1f945-2ab3-44e3-9191-e88c99cd5cd5 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:39:49.839755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-fe2fd7d0-dd30-453c-8a8d-0f66e7098c6a tempest-VolumesSnapshotTestJSON-509137468 tempest-VolumesSnapshotTestJSON-509137468-project] 10.222.0.42 "GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5" status: 404 len: 111 microversion: 2.1 time: 0.030928 May 27 16:39:49.839755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 587/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:39:49 2022] GET /compute/v2.1/servers/75c1f945-2ab3-44e3-9191-e88c99cd5cd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:40:30.073982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:40:30.076760 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:40:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:40:30.964171 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=10 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:30.965022 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:31.151468 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d5540f35-34af-46f4-b224-14382d45370a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Action: 'create', calling method: .version_select at 0x7f0e9f021820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-776713563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHikqmO20193fOu2ASQZfrTCvW1f/olck/8wJQF8wquHvXSjWESBiTp9KoI0lIm3hgQW5GjwcZzgEqNHJAmPIUJeWD2n9Q4rZ059vUoRe2TZnt+HSdC/a6XjHzP+931kQ=="}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:40:31.174878 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-d5540f35-34af-46f4-b224-14382d45370a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for project a7987c5244084c328b132a11290832ba. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:40:31.183398 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-d5540f35-34af-46f4-b224-14382d45370a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for user b1c1a7980121436885dfc548322658fe and project a7987c5244084c328b132a11290832ba. Resources: {'key_pairs'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:40:31.345111 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d5540f35-34af-46f4-b224-14382d45370a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.385952 May 27 16:40:31.345783 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 589/1176] 10.222.0.42 () {60 vars in 1158 bytes} [Fri May 27 16:40:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:40:45.579692 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:40:45.580176 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:40:51.993437 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258535433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776713563", "security_groups": [{"name": "tempest-secgroup-smoke-487079264"}], "block_device_mapping_v2": [{"uuid": "9a70e334-b70c-40a1-b44f-cb672c0b1cd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40bbd07d-37b7-4b97-9458-e5ba68f9fe01"}]}} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:40:52.002811 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:52.003468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:52.107135 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.network.neutron [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] validate_networks() for [('40bbd07d-37b7-4b97-9458-e5ba68f9fe01', None, None, None, None, None)] {{(pid=118487) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:40:52.572889 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:40:52.577809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image limits 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:40:52.577809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:40:52.577809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image pref 0:0:0 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:40:52.577809 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.virt.hardware [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:40:52.584299 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:52.584747 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:52.585569 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:52.586007 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:52.603231 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:40:52.607442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.quota [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for user b1c1a7980121436885dfc548322658fe and project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118487) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:40:52.665510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Going to run 1 instances... {{(pid=118487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:40:52.667593 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a70e334-b70c-40a1-b44f-cb672c0b1cd9',volume_size=None,volume_type=None)] {{(pid=118487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:40:53.078291 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-00365cbc-29ba-45d7-b20d-a0919d54e0b1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.089189 May 27 16:40:53.079257 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 588/1177] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:40:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:40:53.090024 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fd8fc45f-6793-4435-af67-58450c515694 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:53.090649 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fd8fc45f-6793-4435-af67-58450c515694 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:53.092648 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=4 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:53.093308 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:53.152822 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fd8fc45f-6793-4435-af67-58450c515694 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:53.162686 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fd8fc45f-6793-4435-af67-58450c515694 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1094 microversion: 2.1 time: 0.077394 May 27 16:40:53.163263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 590/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:53 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:40:54.181140 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:54.181772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:54.188680 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:54.189134 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:54.189942 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:54.190481 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:54.253242 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:54.260870 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-ca356267-1552-4a51-bf2f-4d65e3e56104 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1144 microversion: 2.1 time: 0.084651 May 27 16:40:54.261496 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 589/1179] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:54 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:40:55.278719 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:55.279402 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:55.286865 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:55.287498 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:55.288301 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:55.288758 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:55.353909 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:55.362850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b2df7d3f-dfbf-4e74-9a75-9cfa3e023503 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1192 microversion: 2.1 time: 0.088147 May 27 16:40:55.363531 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 591/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:55 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:40:56.381639 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:56.382360 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:56.391068 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:56.391524 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:56.392342 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:56.392773 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:56.539184 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:56.547890 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-9c5ef198-1c64-4682-8fe0-7ed73dd74d80 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1277 microversion: 2.1 time: 0.170687 May 27 16:40:56.548476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 590/1181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:56 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:40:57.377607 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-7ee3dbc6-0818-4792-ae7b-6c658691b243 req-31b68c0e-7957-4aff-b4c7-108b6df96440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247bdc47-fb6f-4599-aae0-a669ce4226b8", "tag": "e467a04c-82e3-49e7-8bce-e2d4687f0a8d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:40:57.387577 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-7ee3dbc6-0818-4792-ae7b-6c658691b243 req-31b68c0e-7957-4aff-b4c7-108b6df96440 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:57.388083 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-7ee3dbc6-0818-4792-ae7b-6c658691b243 req-31b68c0e-7957-4aff-b4c7-108b6df96440 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:57.409960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-7ee3dbc6-0818-4792-ae7b-6c658691b243 req-31b68c0e-7957-4aff-b4c7-108b6df96440 service nova] Creating event network-changed:e467a04c-82e3-49e7-8bce-e2d4687f0a8d for instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 on hv-cinder-84049 May 27 16:40:57.418587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-7ee3dbc6-0818-4792-ae7b-6c658691b243 req-31b68c0e-7957-4aff-b4c7-108b6df96440 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051001 May 27 16:40:57.419325 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 592/1182] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:40:57.565822 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:57.566484 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:57.572700 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:57.573147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:57.573941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:57.574382 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:57.715749 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:57.723855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-5147b4ec-64b8-47d9-86df-5f5f52d37d6a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.161694 May 27 16:40:57.724421 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 591/1183] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:57 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:40:58.742253 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:58.742983 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:58.749829 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:58.752406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:58.752406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:58.752406 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:58.883684 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:40:58.892520 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d7388ff2-ec62-46e5-abed-43f71dbf9a84 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.154935 May 27 16:40:58.893109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 593/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:58 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:40:59.910326 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:40:59.911026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:40:59.917746 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:59.918204 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:40:59.918976 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:40:59.920273 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:00.065882 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:00.074489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-738fc4dd-371a-4774-a30c-105e146cf70c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.168005 May 27 16:41:00.075059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 592/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:40:59 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:01.092483 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:01.093117 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:01.099643 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:01.100088 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:01.100880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:01.101317 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:01.231159 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:01.239106 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1276cc1c-f162-4604-b71a-78e81c37e044 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.151038 May 27 16:41:01.239667 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 594/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:01 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:02.257285 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:02.257866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:02.264917 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:02.265378 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:02.266161 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:02.266594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:02.400814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:02.408518 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-03adcd97-4ebd-4ce8-b935-f0ec1bb5f58e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.155283 May 27 16:41:02.409070 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 593/1187] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:02 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:03.425973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:03.426585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:03.429115 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:03.437386 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:03.437905 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:03.438804 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:03.439248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:03.586707 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:03.596579 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-1c46db7d-009b-42fb-b561-12fbf5cd3c65 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.174450 May 27 16:41:03.597212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 595/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:03 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:04.614124 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:04.614734 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:04.616567 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:04.617228 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=6 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:04.624364 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:04.624823 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:04.625636 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:04.626305 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:04.778439 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:04.786346 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-3c6ba3e6-a71b-40ae-a1e6-d429a4042242 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.176075 May 27 16:41:04.786939 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 594/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:04 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:05.803739 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:05.804326 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:05.811475 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:05.811922 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:05.812704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:05.813135 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:05.944712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:05.953734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b0ff0030-1252-46f7-80cf-724d2dae2953 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.153778 May 27 16:41:05.954314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 596/1190] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:05 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:06.970397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:06.971001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:06.976933 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:06.977405 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:06.978162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:06.978589 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:07.124075 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:07.131661 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-dc7dc541-3d7e-44d8-b425-79659f1f120b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.165762 May 27 16:41:07.132216 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 595/1191] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:06 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:08.149363 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:08.149969 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:08.157058 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:08.157537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:08.158304 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:08.158741 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:08.293606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:08.302163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-934e99f6-08f7-4ad7-8369-af46a63dd3e2 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.156618 May 27 16:41:08.302734 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 597/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:08 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:09.177073 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-0506c485-b7eb-40dd-abd1-d79bd6cb986d req-6251857e-f748-495c-9b00-6c62ea9e957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247bdc47-fb6f-4599-aae0-a669ce4226b8", "name": "network-vif-plugged", "status": "completed", "tag": "e467a04c-82e3-49e7-8bce-e2d4687f0a8d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:41:09.185817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0506c485-b7eb-40dd-abd1-d79bd6cb986d req-6251857e-f748-495c-9b00-6c62ea9e957f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:09.186351 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-0506c485-b7eb-40dd-abd1-d79bd6cb986d req-6251857e-f748-495c-9b00-6c62ea9e957f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:09.197801 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-0506c485-b7eb-40dd-abd1-d79bd6cb986d req-6251857e-f748-495c-9b00-6c62ea9e957f service nova] Creating event network-vif-plugged:e467a04c-82e3-49e7-8bce-e2d4687f0a8d for instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 on hv-cinder-84049 May 27 16:41:09.203619 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-0506c485-b7eb-40dd-abd1-d79bd6cb986d req-6251857e-f748-495c-9b00-6c62ea9e957f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097933 May 27 16:41:09.204232 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 596/1193] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:41:09.319120 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:09.319767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:09.326411 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:09.326888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:09.327673 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:09.328122 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:09.463397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:09.471206 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-69655be5-007c-4537-98ae-53452dcd91fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.155972 May 27 16:41:09.471791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 598/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:09 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:10.489267 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:10.489984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:10.496422 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:10.496867 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:10.498147 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:10.498594 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:10.633000 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:10.642053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-243c4db5-1202-480b-a6f6-685b00614c3d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1265 microversion: 2.1 time: 0.157387 May 27 16:41:10.642672 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 597/1195] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:10 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:11.659592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:11.660183 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:11.666681 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:11.667127 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:11.667877 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:11.668306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:11.798685 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:11.806263 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-cb2d2c9a-46b4-400d-b9dd-5cd428eca189 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1451 microversion: 2.1 time: 0.150505 May 27 16:41:11.806830 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 599/1196] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:11 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:11.822426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:41:11.823099 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:41:11.830268 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:11.830718 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:11.831482 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:11.831918 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:11.962074 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:41:11.970215 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d71ec481-6d33-4ae8-978d-076b8c1c268f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1451 microversion: 2.1 time: 0.151586 May 27 16:41:11.970787 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 598/1197] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:41:11 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:41:14.002036 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-cbca3bfc-5542-443d-a6bd-332d1e9b8578 req-c52e4b1d-0442-417d-9feb-486d3ab43f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247bdc47-fb6f-4599-aae0-a669ce4226b8", "tag": "e467a04c-82e3-49e7-8bce-e2d4687f0a8d"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:41:14.010880 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-cbca3bfc-5542-443d-a6bd-332d1e9b8578 req-c52e4b1d-0442-417d-9feb-486d3ab43f97 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:41:14.011330 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-cbca3bfc-5542-443d-a6bd-332d1e9b8578 req-c52e4b1d-0442-417d-9feb-486d3ab43f97 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:41:14.024084 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-cbca3bfc-5542-443d-a6bd-332d1e9b8578 req-c52e4b1d-0442-417d-9feb-486d3ab43f97 service nova] Creating event network-changed:e467a04c-82e3-49e7-8bce-e2d4687f0a8d for instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 on hv-cinder-84049 May 27 16:41:14.034191 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-cbca3bfc-5542-443d-a6bd-332d1e9b8578 req-c52e4b1d-0442-417d-9feb-486d3ab43f97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093164 May 27 16:41:14.034808 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 600/1198] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:42:06.275554 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:42:06.276309 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:43:10.199678 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:10.200361 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=58 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:10.204499 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:10.205152 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:10.212604 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:10.222586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:10.222586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:10.222586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:10.241937 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:43:10.572802 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-932ed9cb-0973-413c-8399-3f2384dd45ae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 204 len: 0 microversion: 2.1 time: 0.374959 May 27 16:43:10.573451 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 599/1199] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:43:10 2022] DELETE /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:43:10.585884 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a9aa4b79-8945-4e69-a9f2-b1f92ec0d773] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 16:43:10.586495 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=24 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:10.587297 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=52 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:10.591816 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:10.592571 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:10.599589 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:10.600045 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:10.600820 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:10.601258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:10.744706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:10.753968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-630e6238-3858-4c6c-9911-6c861224d4fe tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1576 microversion: 2.1 time: 0.168455 May 27 16:43:10.753968 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 601/1200] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:10 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:11.772241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:11.773050 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:11.781148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:11.781630 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:11.782440 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:11.782876 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:11.924436 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:11.932302 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1ba35a94-c7d5-4a5c-8b5e-86be76bcbee8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1576 microversion: 2.1 time: 0.165404 May 27 16:43:11.932874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 600/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:11 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:12.953169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:12.953951 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:12.962621 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:12.963063 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:12.963862 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:12.964293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:12.980791 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] [a9aa4b79-8945-4e69-a9f2-b1f92ec0d773] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 51632. May 27 16:43:13.119346 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:13.130362 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-ff64d2b6-bfef-4736-add8-c79216954067 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1576 microversion: 2.1 time: 0.183975 May 27 16:43:13.130942 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 602/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:12 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:13.524881 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-06d8d14e-f661-4960-800f-2673dee687cc req-50b81bec-3a75-4a9d-b099-3145ed29195f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247bdc47-fb6f-4599-aae0-a669ce4226b8", "name": "network-vif-deleted", "tag": "e467a04c-82e3-49e7-8bce-e2d4687f0a8d"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:43:13.533818 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-06d8d14e-f661-4960-800f-2673dee687cc req-50b81bec-3a75-4a9d-b099-3145ed29195f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:13.534260 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-06d8d14e-f661-4960-800f-2673dee687cc req-50b81bec-3a75-4a9d-b099-3145ed29195f service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:13.546128 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-06d8d14e-f661-4960-800f-2673dee687cc req-50b81bec-3a75-4a9d-b099-3145ed29195f service nova] Creating event network-vif-deleted:e467a04c-82e3-49e7-8bce-e2d4687f0a8d for instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 on hv-cinder-84049 May 27 16:43:13.551545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-06d8d14e-f661-4960-800f-2673dee687cc req-50b81bec-3a75-4a9d-b099-3145ed29195f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 May 27 16:43:13.552342 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 601/1203] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:43:14.149067 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:14.150288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:14.157057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:14.157606 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:14.158587 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:14.159393 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:14.226752 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:14.234447 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-815eb238-bbdc-4d52-bf20-68a06936c152 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 200 len: 1225 microversion: 2.1 time: 0.090401 May 27 16:43:14.235017 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 603/1204] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:14 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:15.252726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:15.253494 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:15.260426 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:15.260866 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:15.261652 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:15.262087 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:15.276222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] HTTP exception thrown: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Request method failure captured: May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 HTTP/1.1 May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP73huxcKiKVp_oD2pxGkJ4hQIhDUPzii0-hUpVI0NQvPcNAuHSUC-PemYj50nVWGmVLzV9weLjdNcv07xTqTQOyVQJ68XytEkBuD2-UtOvt5mBHOnOXIvScmPK_rQRC4dHZN92uuDGRlU6pOH8q-2F6bfwxM4m6dcd2kgUS7qTTlcU May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: a7987c5244084c328b132a11290832ba May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:43:15.278162 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7987c5244084c328b132a11290832ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7987c5244084c328b132a11290832ba", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-TestVolumeBootPattern-738085405 May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: a7987c5244084c328b132a11290832ba May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-TestVolumeBootPattern-738085405-project May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: b1c1a7980121436885dfc548322658fe May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-TestVolumeBootPattern-738085405-project May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:43:15.279887 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '247bdc47-fb6f-4599-aae0-a669ce4226b8'} May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:43:15.280766 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:43:15.282193 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:43:15.283442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Returning 404 to user: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:43:15.283442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a739528f-228b-4581-872d-5f6d2a6d3a95 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 404 len: 111 microversion: 2.1 time: 0.031062 May 27 16:43:15.283442 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 602/1205] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:15 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:43:15.325952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1662860343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776713563", "security_groups": [{"name": "tempest-secgroup-smoke-487079264"}], "block_device_mapping_v2": [{"uuid": "9a70e334-b70c-40a1-b44f-cb672c0b1cd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40bbd07d-37b7-4b97-9458-e5ba68f9fe01"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:43:15.439019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] validate_networks() for [('40bbd07d-37b7-4b97-9458-e5ba68f9fe01', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:43:15.811679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:43:15.812097 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:43:15.812567 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:43:15.813009 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:43:15.813458 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:43:15.822839 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:15.823284 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:15.824100 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:15.824535 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:15.840931 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:43:15.844851 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for user b1c1a7980121436885dfc548322658fe and project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:43:15.904060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:43:15.906306 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a70e334-b70c-40a1-b44f-cb672c0b1cd9',volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:43:16.370507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-25cd98e3-d5f5-451e-b366-e582cc25da97 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.048416 May 27 16:43:16.371189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 604/1206] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:43:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 16:43:16.381425 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0e913c77-3a64-4824-92ad-4e5fb0ea6783 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:16.382109 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0e913c77-3a64-4824-92ad-4e5fb0ea6783 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:16.437653 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0e913c77-3a64-4824-92ad-4e5fb0ea6783 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:16.456158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0e913c77-3a64-4824-92ad-4e5fb0ea6783 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1094 microversion: 2.1 time: 0.068145 May 27 16:43:16.456158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 603/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:16 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:17.464246 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:17.464843 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:17.471394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:17.471699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:17.472644 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:17.473077 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:17.535882 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:17.546305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-36f438de-4e8a-4091-8f94-84015fc7d43b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1144 microversion: 2.1 time: 0.086359 May 27 16:43:17.546894 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 605/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:17 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:18.569013 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:18.569706 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:18.577098 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:18.577583 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:18.580317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:18.580317 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:18.641255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:18.648908 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-23c40dd1-0720-4f5f-9a60-7b5b3554e451 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1200 microversion: 2.1 time: 0.084388 May 27 16:43:18.649712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 604/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:18 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:19.668944 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:19.669642 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:19.676761 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:19.677249 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:19.678071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:19.678507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:19.824973 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:19.836430 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-192d10f5-9630-45f3-bf08-eb839c78ae76 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1277 microversion: 2.1 time: 0.172867 May 27 16:43:19.838086 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 606/1210] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:19 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:43:20.421149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-818d1aa6-00f6-4006-9965-e8d76843191a req-8164a972-aee2-412d-a03b-e0ba48427b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140cc9f9-20a4-4407-b094-00f10e059043", "tag": "b70dc578-c6ca-487d-85f2-51e7fa2e2732"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:43:20.433059 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-818d1aa6-00f6-4006-9965-e8d76843191a req-8164a972-aee2-412d-a03b-e0ba48427b48 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:20.433759 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-818d1aa6-00f6-4006-9965-e8d76843191a req-8164a972-aee2-412d-a03b-e0ba48427b48 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:20.445858 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-818d1aa6-00f6-4006-9965-e8d76843191a req-8164a972-aee2-412d-a03b-e0ba48427b48 service nova] Creating event network-changed:b70dc578-c6ca-487d-85f2-51e7fa2e2732 for instance 140cc9f9-20a4-4407-b094-00f10e059043 on hv-cinder-84049 May 27 16:43:20.451001 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-818d1aa6-00f6-4006-9965-e8d76843191a req-8164a972-aee2-412d-a03b-e0ba48427b48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 May 27 16:43:20.451798 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 605/1211] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:43:20.854952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:20.855583 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:20.862513 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:20.862971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:20.863921 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:20.864556 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:21.009057 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:21.017169 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5cbab5a0-5943-4a18-a4c2-019252f3c601 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.165951 May 27 16:43:21.017819 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 607/1212] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:20 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:22.036602 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:22.037292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:22.043618 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:22.044057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:22.044816 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:22.045250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:22.197374 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:22.205090 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1a635a08-f746-429a-9ce6-020e52f56e08 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.173203 May 27 16:43:22.205697 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 606/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:22 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:23.221706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:23.222258 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:23.229699 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:23.230153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:23.231021 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:23.231464 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:23.365850 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:23.373312 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b0d7bbc7-34ee-4617-9219-40da81426d7d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.155751 May 27 16:43:23.373908 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 608/1214] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:23 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:24.390772 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:24.391391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:24.398755 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:24.399201 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:24.399971 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:24.400408 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:24.538197 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:24.545785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4b9abffc-d8f5-467b-beaa-74ad7a0e7225 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.158699 May 27 16:43:24.546349 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 607/1215] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:24 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:25.562708 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:25.563278 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:25.570630 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:25.571052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:25.571802 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:25.572234 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:25.705882 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:25.713895 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f61cb311-90f7-491e-934d-c3e452700a52 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.155008 May 27 16:43:25.714538 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 609/1216] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:25 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:26.731213 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:26.731813 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:26.734315 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:26.739930 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:26.740467 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:26.741552 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:26.741984 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:26.884312 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:26.892453 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-cabb5267-e335-4c60-b639-bf169f995d33 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.165407 May 27 16:43:26.893009 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 608/1217] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:26 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:27.909465 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:27.910239 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:27.913015 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:27.914117 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:27.920774 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:27.930271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:27.930271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:27.930271 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:28.076888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:28.086110 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-f411e8b9-7f51-49ae-8cde-a4946d21a773 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.180412 May 27 16:43:28.086720 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 610/1218] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:27 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:29.103513 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:29.104058 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:29.110543 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:29.110986 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:29.111731 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:29.112158 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:29.244959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:29.252586 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f898a709-25b3-43bb-bbaa-e9622d002e55 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.153004 May 27 16:43:29.253149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 609/1219] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:29 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:30.269507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:30.270721 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:30.277305 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:30.277854 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:30.278616 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:30.279048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:30.412027 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:30.419581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-193c523b-5bc5-4c23-9dd6-9a819bfcb49c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.154018 May 27 16:43:30.420151 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 611/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:30 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:31.436570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:31.437182 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:31.445379 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:31.465941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:31.465941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:31.465941 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:31.586119 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:31.594711 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d9812c84-94ec-423b-b637-54bc2d94641d tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.161991 May 27 16:43:31.595311 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 610/1221] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:31 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:31.767180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-6057bcc6-1ea1-4cb1-a4e0-865b24bb4fcf req-aaa0a219-be23-4bdf-abd3-6668d788b848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140cc9f9-20a4-4407-b094-00f10e059043", "name": "network-vif-plugged", "status": "completed", "tag": "b70dc578-c6ca-487d-85f2-51e7fa2e2732"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:43:31.776706 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6057bcc6-1ea1-4cb1-a4e0-865b24bb4fcf req-aaa0a219-be23-4bdf-abd3-6668d788b848 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:31.777160 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-6057bcc6-1ea1-4cb1-a4e0-865b24bb4fcf req-aaa0a219-be23-4bdf-abd3-6668d788b848 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:31.789197 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-6057bcc6-1ea1-4cb1-a4e0-865b24bb4fcf req-aaa0a219-be23-4bdf-abd3-6668d788b848 service nova] Creating event network-vif-plugged:b70dc578-c6ca-487d-85f2-51e7fa2e2732 for instance 140cc9f9-20a4-4407-b094-00f10e059043 on hv-cinder-84049 May 27 16:43:31.794691 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-6057bcc6-1ea1-4cb1-a4e0-865b24bb4fcf req-aaa0a219-be23-4bdf-abd3-6668d788b848 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031206 May 27 16:43:31.795289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 612/1222] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:43:32.616222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:32.616874 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:32.627856 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:32.628301 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:32.629187 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:32.630105 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:32.759891 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:32.767609 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-1a4d174c-5f11-4c38-b59c-a21df7b8d4b0 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.158683 May 27 16:43:32.767932 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 611/1223] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:32 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:33.785053 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:33.790203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:33.792622 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:33.793068 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:33.793901 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:33.794320 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:33.931198 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:33.939074 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-29ff707b-f7c9-487d-8c61-beb6b17fe1a3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1265 microversion: 2.1 time: 0.158769 May 27 16:43:33.939651 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 613/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:33 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:34.958459 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:34.959092 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:34.965255 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:34.965727 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:34.966476 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:34.966899 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:35.110950 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:35.119666 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4a535c83-3fae-46d4-8312-c213048075b9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1451 microversion: 2.1 time: 0.165860 May 27 16:43:35.120241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 612/1225] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:34 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:35.142779 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:43:35.143392 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:43:35.150617 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:35.151070 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:35.151835 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:35.152276 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:35.288954 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:43:35.296659 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-fd68b3d7-580f-46e3-96b1-7f8c3984dd8b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1451 microversion: 2.1 time: 0.157826 May 27 16:43:35.297226 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 614/1226] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:43:35 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:43:37.301038 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-fe63f7d6-e254-4182-bb21-0ee9026c98b8 req-0bc3b38e-aa21-488d-8a35-5b78ecc3b11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140cc9f9-20a4-4407-b094-00f10e059043", "tag": "b70dc578-c6ca-487d-85f2-51e7fa2e2732"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:43:37.309862 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fe63f7d6-e254-4182-bb21-0ee9026c98b8 req-0bc3b38e-aa21-488d-8a35-5b78ecc3b11c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:43:37.310580 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-fe63f7d6-e254-4182-bb21-0ee9026c98b8 req-0bc3b38e-aa21-488d-8a35-5b78ecc3b11c service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:43:37.322955 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-fe63f7d6-e254-4182-bb21-0ee9026c98b8 req-0bc3b38e-aa21-488d-8a35-5b78ecc3b11c service nova] Creating event network-changed:b70dc578-c6ca-487d-85f2-51e7fa2e2732 for instance 140cc9f9-20a4-4407-b094-00f10e059043 on hv-cinder-84049 May 27 16:43:37.327953 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-fe63f7d6-e254-4182-bb21-0ee9026c98b8 req-0bc3b38e-aa21-488d-8a35-5b78ecc3b11c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030641 May 27 16:43:37.328712 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 613/1227] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:43:50.084732 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:43:50.085403 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:44:05.589262 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:44:05.590113 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:45:13.177767 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:13.178515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=76 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:13.182431 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569659436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776713563", "security_groups": [{"name": "tempest-secgroup-smoke-487079264"}], "block_device_mapping_v2": [{"uuid": "ebe6d830-b87d-4bb7-a0e0-0565b8af36d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40bbd07d-37b7-4b97-9458-e5ba68f9fe01"}]}} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:45:13.441140 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.network.neutron [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] validate_networks() for [('40bbd07d-37b7-4b97-9458-e5ba68f9fe01', None, None, None, None, None)] {{(pid=118488) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 16:45:13.866342 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 16:45:13.866770 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image limits 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 16:45:13.867245 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Flavor pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 16:45:13.867654 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Image pref 0:0:0 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 16:45:13.868070 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.virt.hardware [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 16:45:13.877013 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:13.877494 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:13.878338 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:13.878773 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:13.896882 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 16:45:13.901033 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.quota [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Getting quotas for user b1c1a7980121436885dfc548322658fe and project a7987c5244084c328b132a11290832ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 16:45:13.960256 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Going to run 1 instances... {{(pid=118488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 16:45:13.962411 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebe6d830-b87d-4bb7-a0e0-0565b8af36d3',volume_size=None,volume_type=None)] {{(pid=118488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 16:45:14.358971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6322e92a-7e08-4734-8892-dcd38f30fec4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.182926 May 27 16:45:14.360087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 615/1228] 10.222.0.42 () {60 vars in 1146 bytes} [Fri May 27 16:45:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 16:45:14.368466 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:14.369218 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:14.373600 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-52c5d777-2914-4955-8d0c-1aaa23dec162 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:14.374303 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-52c5d777-2914-4955-8d0c-1aaa23dec162 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:14.490010 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-52c5d777-2914-4955-8d0c-1aaa23dec162 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:14.493023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-52c5d777-2914-4955-8d0c-1aaa23dec162 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1093 microversion: 2.1 time: 0.126374 May 27 16:45:14.493761 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 614/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:14 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:15.511422 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:15.512124 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:15.519283 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:15.519750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:15.520653 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:15.521091 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:15.588475 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:15.594130 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-5a5d7466-cf8c-4827-a305-cc37cff0b1c5 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1135 microversion: 2.1 time: 0.087299 May 27 16:45:15.594803 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 616/1230] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:15 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:16.613078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:16.613784 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:16.622144 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:16.622769 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:16.624020 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:16.624722 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:16.689883 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:16.697871 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f8924b12-e544-4e79-b2fb-435965c2873e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1199 microversion: 2.1 time: 0.089559 May 27 16:45:16.698553 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 615/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:16 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:17.717605 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:17.718359 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:17.725871 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:17.726456 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:17.727360 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:17.727869 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:17.866508 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:17.874203 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-a5d9a578-1e95-4547-be2a-ba5a66317361 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1276 microversion: 2.1 time: 0.160565 May 27 16:45:17.874765 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 617/1232] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:17 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:18.366391 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-45cf0eeb-4ef3-4a1f-adc5-9844861483ee req-6ed39104-36e9-4b19-a67a-b1dceb6bbb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f812d3a3-211b-4f37-8664-fa16be45c50d", "tag": "45ae4846-f756-4533-90c7-b59e7d6cfcd6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:45:18.375014 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-45cf0eeb-4ef3-4a1f-adc5-9844861483ee req-6ed39104-36e9-4b19-a67a-b1dceb6bbb61 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:18.375459 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-45cf0eeb-4ef3-4a1f-adc5-9844861483ee req-6ed39104-36e9-4b19-a67a-b1dceb6bbb61 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:18.389906 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-45cf0eeb-4ef3-4a1f-adc5-9844861483ee req-6ed39104-36e9-4b19-a67a-b1dceb6bbb61 service nova] Creating event network-changed:45ae4846-f756-4533-90c7-b59e7d6cfcd6 for instance f812d3a3-211b-4f37-8664-fa16be45c50d on hv-cinder-84049 May 27 16:45:18.396173 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-45cf0eeb-4ef3-4a1f-adc5-9844861483ee req-6ed39104-36e9-4b19-a67a-b1dceb6bbb61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099076 May 27 16:45:18.396951 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 616/1233] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:45:18.895572 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:18.896189 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:18.902912 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:18.903394 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:18.904175 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:18.904612 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:19.062279 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:19.070952 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-de06d6b1-cfc2-4f28-9059-e82246ea52c4 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.179328 May 27 16:45:19.071537 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 618/1234] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:18 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:20.089505 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:20.090206 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:20.097250 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:20.097785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:20.098545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:20.098982 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:20.231617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:20.240114 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-4b7f7cab-1176-46e3-a490-97398f584f5e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.155268 May 27 16:45:20.240695 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 617/1235] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:20 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:21.257071 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:21.257650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:21.264129 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:21.264581 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:21.265366 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:21.265810 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:21.395748 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:21.403226 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c08aa912-e52b-4b25-9fca-2091959d99fc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.150088 May 27 16:45:21.403792 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 619/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:21 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:45:22.419978 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:22.420581 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:22.427571 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:22.428028 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:22.428789 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:22.429265 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:22.567916 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:22.575885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-93a5590b-6262-4708-9592-acb30428e52a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.159741 May 27 16:45:22.576710 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 618/1237] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:22 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:23.594352 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:23.595660 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:23.601992 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:23.602445 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:23.603213 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:23.603650 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:23.735712 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:23.743538 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-3a7534cd-017b-47df-aee0-2555803e9799 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.153016 May 27 16:45:23.744109 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 620/1238] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:23 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:24.760222 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:24.760810 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:24.763347 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell0:SELECT=2 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:24.769093 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:24.774545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:24.774545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:24.774545 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:24.906397 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:24.915082 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-0dbd0183-71d1-4396-8e6f-9a417b603011 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.158876 May 27 16:45:24.915658 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 619/1239] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:24 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:25.933364 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:25.934016 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:25.935841 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=2 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:25.936509 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell0:SELECT=6 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:25.942886 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:25.943343 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:25.944153 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:25.944592 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:26.081102 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:26.088580 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-2d3ea845-3daf-48d1-b41d-99f99ec919c1 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.159143 May 27 16:45:26.089144 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 621/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:25 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:27.105617 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:27.106304 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:27.116288 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:27.116727 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:27.117511 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:27.117948 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:27.265838 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:27.274587 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-268fc95f-a776-4d50-872f-ea9fc6385b4f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.172814 May 27 16:45:27.275148 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 620/1241] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:27 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:28.291772 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:28.292491 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:28.299499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:28.299960 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:28.300750 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:28.301221 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:28.452472 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:28.461585 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-c87432f0-c890-46d7-9b86-ecd18c51fc38 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.173703 May 27 16:45:28.462176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 622/1242] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:28 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:29.482043 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:29.482625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:29.489443 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:29.489885 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:29.490629 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:29.491056 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:29.620603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:29.628570 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-916adc07-f652-4409-98aa-466095d3d288 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.150456 May 27 16:45:29.629132 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 621/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:29 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:30.351141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-338836b0-35ce-4c0d-956b-06ead5f1541d req-04b22e71-6205-40f4-a440-c39d44e08e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f812d3a3-211b-4f37-8664-fa16be45c50d", "name": "network-vif-plugged", "status": "completed", "tag": "45ae4846-f756-4533-90c7-b59e7d6cfcd6"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:45:30.359488 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-338836b0-35ce-4c0d-956b-06ead5f1541d req-04b22e71-6205-40f4-a440-c39d44e08e6d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:30.359918 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-338836b0-35ce-4c0d-956b-06ead5f1541d req-04b22e71-6205-40f4-a440-c39d44e08e6d service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:30.371879 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-338836b0-35ce-4c0d-956b-06ead5f1541d req-04b22e71-6205-40f4-a440-c39d44e08e6d service nova] Creating event network-vif-plugged:45ae4846-f756-4533-90c7-b59e7d6cfcd6 for instance f812d3a3-211b-4f37-8664-fa16be45c50d on hv-cinder-84049 May 27 16:45:30.377048 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-338836b0-35ce-4c0d-956b-06ead5f1541d req-04b22e71-6205-40f4-a440-c39d44e08e6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029762 May 27 16:45:30.377691 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 623/1244] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:45:30.692551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:30.694126 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:30.699287 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:30.699733 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:30.700486 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:30.700920 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:31.093689 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:31.101660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-bf6c621d-592d-4530-ad37-1f7796ba2fe3 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.460158 May 27 16:45:31.102226 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 622/1245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:30 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:32.120864 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:32.121582 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:32.128479 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:32.128926 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:32.129737 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:32.130180 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:32.260787 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:32.268377 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-b8046f12-b709-428f-bfad-ef9d0b024820 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1264 microversion: 2.1 time: 0.152209 May 27 16:45:32.268945 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 624/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:32 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:33.285489 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:33.286052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:33.292537 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:33.292991 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:33.293744 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:33.294169 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:33.428406 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:33.436057 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-f48ea250-5f15-4d4f-87be-e3b44f15db91 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1450 microversion: 2.1 time: 0.154697 May 27 16:45:33.436625 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 623/1247] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:33 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:33.452809 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:45:33.453452 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:45:33.460289 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:33.460745 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:33.461552 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:33.461995 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:33.593222 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:45:33.602163 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-09de18d2-d2e6-41b7-8844-54656ce66dae tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1450 microversion: 2.1 time: 0.153118 May 27 16:45:33.602746 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 625/1248] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:45:33 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:45:35.794433 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-14f6f3db-bde3-409e-ac21-184889ea2b33 req-ecd26428-55bb-491d-ba84-684f56a770c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f812d3a3-211b-4f37-8664-fa16be45c50d", "tag": "45ae4846-f756-4533-90c7-b59e7d6cfcd6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:45:35.808947 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-14f6f3db-bde3-409e-ac21-184889ea2b33 req-ecd26428-55bb-491d-ba84-684f56a770c8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:45:35.814023 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-14f6f3db-bde3-409e-ac21-184889ea2b33 req-ecd26428-55bb-491d-ba84-684f56a770c8 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:45:35.821280 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-14f6f3db-bde3-409e-ac21-184889ea2b33 req-ecd26428-55bb-491d-ba84-684f56a770c8 service nova] Creating event network-changed:45ae4846-f756-4533-90c7-b59e7d6cfcd6 for instance f812d3a3-211b-4f37-8664-fa16be45c50d on hv-cinder-84049 May 27 16:45:35.826370 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-14f6f3db-bde3-409e-ac21-184889ea2b33 req-ecd26428-55bb-491d-ba84-684f56a770c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035616 May 27 16:45:35.827253 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 624/1249] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 16:45:36.416974 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:45:36.417558 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:47:10.094124 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:47:10.094726 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:47:14.600700 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:47:14.601665 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG dbcounter [-] [118488] Writing DB stats nova_cell1:SELECT=58 {{(pid=118488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:47:14.603970 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_api:SELECT=24 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:47:14.604979 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG dbcounter [-] [118487] Writing DB stats nova_cell1:SELECT=52 {{(pid=118487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:47:14.606888 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:14.607755 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:14.614314 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:14.614919 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:14.615766 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:14.616185 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:14.643559 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Going to try to terminate instance {{(pid=118488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:47:14.672664 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-c717c192-d959-4045-939f-1b04523cd4b8 req-f820acbd-0ec3-4ff3-a293-2943fe1e2d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f812d3a3-211b-4f37-8664-fa16be45c50d", "tag": "45ae4846-f756-4533-90c7-b59e7d6cfcd6"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:47:14.681640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c717c192-d959-4045-939f-1b04523cd4b8 req-f820acbd-0ec3-4ff3-a293-2943fe1e2d03 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:14.682084 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-c717c192-d959-4045-939f-1b04523cd4b8 req-f820acbd-0ec3-4ff3-a293-2943fe1e2d03 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:14.695292 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-c717c192-d959-4045-939f-1b04523cd4b8 req-f820acbd-0ec3-4ff3-a293-2943fe1e2d03 service nova] Creating event network-changed:45ae4846-f756-4533-90c7-b59e7d6cfcd6 for instance f812d3a3-211b-4f37-8664-fa16be45c50d on hv-cinder-84049 May 27 16:47:14.699817 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-c717c192-d959-4045-939f-1b04523cd4b8 req-f820acbd-0ec3-4ff3-a293-2943fe1e2d03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097733 May 27 16:47:14.700362 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 625/1250] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:47:14.985730 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-357c95c2-3c57-426a-a075-c1467059463e tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 204 len: 0 microversion: 2.1 time: 0.386485 May 27 16:47:14.989293 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 626/1251] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:47:14 2022] DELETE /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:47:14.999434 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:15.000465 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:15.009053 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:15.009525 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:15.011277 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:15.011606 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:15.150735 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:15.159515 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-b0cb6cef-26ff-417d-97ce-6daa371b3197 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1575 microversion: 2.1 time: 0.165055 May 27 16:47:15.168138 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 626/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:14 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:16.179443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:16.180141 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:16.186896 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:16.187287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:16.188052 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:16.188489 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:16.334674 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:16.334971 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-aa366968-3a61-4bff-8595-4b52b5b43192 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1575 microversion: 2.1 time: 0.159420 May 27 16:47:16.335327 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 627/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:16 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:17.352452 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:17.353107 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:17.361757 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:17.362241 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:17.363028 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:17.363469 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:17.506778 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:17.515308 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-d4a28c5a-f0ef-4c2a-91ec-2d33ac9d542c tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1456 microversion: 2.1 time: 0.166629 May 27 16:47:17.515819 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 627/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:17 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:17.839716 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-394fb4c3-f210-453e-8041-83a2b1060d75 req-3d5737d1-52e8-411d-a140-d0019e2b3c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f812d3a3-211b-4f37-8664-fa16be45c50d", "name": "network-vif-deleted", "tag": "45ae4846-f756-4533-90c7-b59e7d6cfcd6"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:47:17.850056 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-394fb4c3-f210-453e-8041-83a2b1060d75 req-3d5737d1-52e8-411d-a140-d0019e2b3c51 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:17.852150 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-394fb4c3-f210-453e-8041-83a2b1060d75 req-3d5737d1-52e8-411d-a140-d0019e2b3c51 service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:17.862248 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-394fb4c3-f210-453e-8041-83a2b1060d75 req-3d5737d1-52e8-411d-a140-d0019e2b3c51 service nova] Creating event network-vif-deleted:45ae4846-f756-4533-90c7-b59e7d6cfcd6 for instance f812d3a3-211b-4f37-8664-fa16be45c50d on hv-cinder-84049 May 27 16:47:17.867257 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-394fb4c3-f210-453e-8041-83a2b1060d75 req-3d5737d1-52e8-411d-a140-d0019e2b3c51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 May 27 16:47:17.867834 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 628/1255] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:47:18.533256 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:18.533913 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:18.540510 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:18.540959 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:18.541785 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:18.542217 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:18.611294 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:18.621846 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-7b94d071-5025-4c3e-87de-447f6cbf6d94 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 200 len: 1224 microversion: 2.1 time: 0.093458 May 27 16:47:18.622438 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 628/1256] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:18 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:19.641235 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:19.641955 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: f812d3a3-211b-4f37-8664-fa16be45c50d] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:19.648375 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:19.652657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:19.652657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:19.652657 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:19.669473 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] HTTP exception thrown: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Request method failure captured: May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d HTTP/1.1 May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikP73huxcKiKVp_oD2pxGkJ4hQIhDUPzii0-hUpVI0NQvPcNAuHSUC-PemYj50nVWGmVLzV9weLjdNcv07xTqTQOyVQJ68XytEkBuD2-UtOvt5mBHOnOXIvScmPK_rQRC4dHZN92uuDGRlU6pOH8q-2F6bfwxM4m6dcd2kgUS7qTTlcU May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: a7987c5244084c328b132a11290832ba May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:47:19.672611 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7987c5244084c328b132a11290832ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7987c5244084c328b132a11290832ba", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-TestVolumeBootPattern-738085405 May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: a7987c5244084c328b132a11290832ba May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: b1c1a7980121436885dfc548322658fe May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. May 27 16:47:19.677566 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': 'f812d3a3-211b-4f37-8664-fa16be45c50d'} May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:47:19.678704 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. May 27 16:47:19.681499 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:19.684339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Returning 404 to user: Instance f812d3a3-211b-4f37-8664-fa16be45c50d could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:47:19.684339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-0cdd181e-0296-45fb-b8e0-4f32a306d1f8 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d" status: 404 len: 111 microversion: 2.1 time: 0.037638 May 27 16:47:19.684339 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 629/1257] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:19 2022] GET /compute/v2.1/servers/f812d3a3-211b-4f37-8664-fa16be45c50d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:47:23.056748 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:23.057912 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:23.062277 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [req-59d9f87e-0c43-44f2-b2e8-3b70e748f53a req-5a028208-5b46-4e9e-8989-766a390b61fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140cc9f9-20a4-4407-b094-00f10e059043", "tag": "b70dc578-c6ca-487d-85f2-51e7fa2e2732"}]} {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:47:23.067691 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:23.068468 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:23.069514 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:23.070178 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:23.087679 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-59d9f87e-0c43-44f2-b2e8-3b70e748f53a req-5a028208-5b46-4e9e-8989-766a390b61fe service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:23.088126 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [req-59d9f87e-0c43-44f2-b2e8-3b70e748f53a req-5a028208-5b46-4e9e-8989-766a390b61fe service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:23.102757 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.compute.server_external_events [req-59d9f87e-0c43-44f2-b2e8-3b70e748f53a req-5a028208-5b46-4e9e-8989-766a390b61fe service nova] Creating event network-changed:b70dc578-c6ca-487d-85f2-51e7fa2e2732 for instance 140cc9f9-20a4-4407-b094-00f10e059043 on hv-cinder-84049 May 27 16:47:23.103085 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Going to try to terminate instance {{(pid=118487) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 16:47:23.108732 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [req-59d9f87e-0c43-44f2-b2e8-3b70e748f53a req-5a028208-5b46-4e9e-8989-766a390b61fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053875 May 27 16:47:23.113139 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 630/1258] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:47:23.441835 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-a985bc38-4d2c-4beb-8347-e0d3f235418f tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 204 len: 0 microversion: 2.1 time: 0.387722 May 27 16:47:23.442852 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 629/1259] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:47:23 2022] DELETE /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 16:47:23.457093 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:23.458154 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:23.466549 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:23.467315 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:23.471188 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:23.471933 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:23.638019 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:23.641588 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-58ff7cb8-a285-4a18-86fc-b5b2332865d9 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1575 microversion: 2.1 time: 0.191805 May 27 16:47:23.642371 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 631/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:23 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 16:47:24.660612 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:24.661008 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:24.667788 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:24.668237 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:24.668994 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:24.669456 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:24.807855 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.policy [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118487) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:24.815753 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-69814aff-1f40-4cc0-80e3-f9aa7850924b tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1575 microversion: 2.1 time: 0.160523 May 27 16:47:24.816551 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 630/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:24 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:25.598839 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:47:25.599136 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:47:25.832583 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:25.833131 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:25.839672 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:25.840103 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:25.840855 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:25.841287 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:25.902568 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:25.911610 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-327be0b3-880b-4099-b6e0-a88151937009 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1390 microversion: 2.1 time: 0.083398 May 27 16:47:25.912721 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 632/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:25 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:25.972603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [req-1e663032-45a3-475d-9d06-459613ff4014 req-999b0f11-979a-4503-86a0-36ed0c8f27ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140cc9f9-20a4-4407-b094-00f10e059043", "name": "network-vif-deleted", "tag": "b70dc578-c6ca-487d-85f2-51e7fa2e2732"}]} {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 16:47:25.981603 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-1e663032-45a3-475d-9d06-459613ff4014 req-999b0f11-979a-4503-86a0-36ed0c8f27ba service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:25.982052 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [req-1e663032-45a3-475d-9d06-459613ff4014 req-999b0f11-979a-4503-86a0-36ed0c8f27ba service nova] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:25.994795 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.compute.server_external_events [req-1e663032-45a3-475d-9d06-459613ff4014 req-999b0f11-979a-4503-86a0-36ed0c8f27ba service nova] Creating event network-vif-deleted:b70dc578-c6ca-487d-85f2-51e7fa2e2732 for instance 140cc9f9-20a4-4407-b094-00f10e059043 on hv-cinder-84049 May 27 16:47:25.999895 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [req-1e663032-45a3-475d-9d06-459613ff4014 req-999b0f11-979a-4503-86a0-36ed0c8f27ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031850 May 27 16:47:26.000354 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 631/1263] 10.222.0.42 () {64 vars in 1317 bytes} [Fri May 27 16:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 16:47:26.929443 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:26.930060 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:26.937818 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:26.938268 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:26.939087 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:26.939518 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:26.976698 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:26.977147 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:26.977701 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.objects.instance [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lazy-loading 'fault' on Instance uuid 140cc9f9-20a4-4407-b094-00f10e059043 {{(pid=118488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 16:47:27.023990 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.policy [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1c1a7980121436885dfc548322658fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7987c5244084c328b132a11290832ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118488) authorize /opt/stack/nova/nova/policy.py:199}} May 27 16:47:27.032162 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-d8ff24dc-3912-425f-bc82-7307396cf61a tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 200 len: 1230 microversion: 2.1 time: 0.106681 May 27 16:47:27.032740 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 633/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:26 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 16:47:28.051926 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:28.052708 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 140cc9f9-20a4-4407-b094-00f10e059043] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:28.059096 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.059544 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.060309 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.060775 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.075042 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] HTTP exception thrown: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Request method failure captured: May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 HTTP/1.1 May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP73huxcKiKVp_oD2pxGkJ4hQIhDUPzii0-hUpVI0NQvPcNAuHSUC-PemYj50nVWGmVLzV9weLjdNcv07xTqTQOyVQJ68XytEkBuD2-UtOvt5mBHOnOXIvScmPK_rQRC4dHZN92uuDGRlU6pOH8q-2F6bfwxM4m6dcd2kgUS7qTTlcU May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:47:28.076793 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7987c5244084c328b132a11290832ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7987c5244084c328b132a11290832ba", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: b1c1a7980121436885dfc548322658fe May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. May 27 16:47:28.078390 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '140cc9f9-20a4-4407-b094-00f10e059043'} May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:47:28.080018 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. May 27 16:47:28.081865 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.083069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Returning 404 to user: Instance 140cc9f9-20a4-4407-b094-00f10e059043 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:47:28.083069 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-275de9c7-b109-4b41-8ff0-22b7fb23f388 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043" status: 404 len: 111 microversion: 2.1 time: 0.032275 May 27 16:47:28.084790 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 632/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:28 2022] GET /compute/v2.1/servers/140cc9f9-20a4-4407-b094-00f10e059043 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:47:28.599049 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:28.599590 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.compute.api [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118488) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:28.606176 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.606627 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.607397 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.607838 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG oslo_concurrency.lockutils [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.621862 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.wsgi [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] HTTP exception thrown: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Request method failure captured: May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: request: DELETE /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 HTTP/1.1 May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept: application/json May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Accept-Encoding: identity May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Connection: close May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Length: 0 May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Content-Type: application/json May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Host: 10.222.0.42 May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Openstack-System-Scope: None May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: User-Agent: python-urllib3/1.26.9 May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Auth-Token: gAAAAABikP73huxcKiKVp_oD2pxGkJ4hQIhDUPzii0-hUpVI0NQvPcNAuHSUC-PemYj50nVWGmVLzV9weLjdNcv07xTqTQOyVQJ68XytEkBuD2-UtOvt5mBHOnOXIvScmPK_rQRC4dHZN92uuDGRlU6pOH8q-2F6bfwxM4m6dcd2kgUS7qTTlcU May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Id: None May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Domain-Name: None May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Identity-Status: Confirmed May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Is-Admin-Project: True May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Id: default May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Domain-Name: Default May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Project-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Role: reader,member May 27 16:47:28.623515 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Roles: reader,member May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7987c5244084c328b132a11290832ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7987c5244084c328b132a11290832ba", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-Tenant-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Id: default May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Domain-Name: Default May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Id: b1c1a7980121436885dfc548322658fe May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: X-User-Name: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: method: > May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: exception: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.625212 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: action_args: {'id': '247bdc47-fb6f-4599-aae0-a669ce4226b8'} May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:47:28.626861 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.628288 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: ERROR nova.api.openstack.wsgi May 27 16:47:28.635264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Returning 404 to user: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. {{(pid=118488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:47:28.635264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-6cc3fa4d-4c6f-45e0-ac99-51caa5f17a66 tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 404 len: 111 microversion: 2.1 time: 0.030370 May 27 16:47:28.635264 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 634/1266] 10.222.0.42 () {58 vars in 1238 bytes} [Fri May 27 16:47:28 2022] DELETE /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:47:28.635814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '>' {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:28.635814 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.compute.api [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] [instance: 247bdc47-fb6f-4599-aae0-a669ce4226b8] Fetching instance by UUID {{(pid=118487) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 16:47:28.641122 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.641660 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.642980 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 16:47:28.643409 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG oslo_concurrency.lockutils [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Lock "6293b2d6-a723-4343-b59c-2c55f0df4078" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 16:47:28.656831 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.wsgi [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] HTTP exception thrown: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Request method failure captured: May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: request: GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 HTTP/1.1 May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept: application/json May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Accept-Encoding: identity May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Connection: close May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Length: 0 May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Content-Type: application/json May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Host: 10.222.0.42 May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Openstack-System-Scope: None May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: User-Agent: python-urllib3/1.26.9 May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Auth-Token: gAAAAABikP73huxcKiKVp_oD2pxGkJ4hQIhDUPzii0-hUpVI0NQvPcNAuHSUC-PemYj50nVWGmVLzV9weLjdNcv07xTqTQOyVQJ68XytEkBuD2-UtOvt5mBHOnOXIvScmPK_rQRC4dHZN92uuDGRlU6pOH8q-2F6bfwxM4m6dcd2kgUS7qTTlcU May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Id: None May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Domain-Name: None May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Identity-Status: Confirmed May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Is-Admin-Project: True May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Id: default May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Domain-Name: Default May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Project-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Role: reader,member May 27 16:47:28.658479 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Roles: reader,member May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7987c5244084c328b132a11290832ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7987c5244084c328b132a11290832ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7987c5244084c328b132a11290832ba", "adminURL": "http://10.222.0.42:8080"}]}] May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Id: a7987c5244084c328b132a11290832ba May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-Tenant-Name: tempest-TestVolumeBootPattern-738085405 May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Id: default May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Domain-Name: Default May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Id: b1c1a7980121436885dfc548322658fe May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: X-User-Name: tempest-TestVolumeBootPattern-738085405-project May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: method: > May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: exception: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.660296 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: action_args: {'id': '247bdc47-fb6f-4599-aae0-a669ce4226b8'} May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: {{(pid=118487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 16:47:28.664647 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. May 27 16:47:28.670026 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: ERROR nova.api.openstack.wsgi May 27 16:47:28.673850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: DEBUG nova.api.openstack.wsgi [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Returning 404 to user: Instance 247bdc47-fb6f-4599-aae0-a669ce4226b8 could not be found. {{(pid=118487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 16:47:28.673850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO nova.api.openstack.requestlog [None req-261d50a6-24c1-4a4f-af7c-03f083a7dfdf tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8" status: 404 len: 111 microversion: 2.1 time: 0.029282 May 27 16:47:28.673850 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: [pid: 118487|app: 0|req: 633/1267] 10.222.0.42 () {58 vars in 1235 bytes} [Fri May 27 16:47:28 2022] GET /compute/v2.1/servers/247bdc47-fb6f-4599-aae0-a669ce4226b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 16:47:30.211936 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: DEBUG nova.api.openstack.wsgi [None req-286d0db3-8012-4d31-bcc1-54cdc88eadbc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] Calling method '.version_select at 0x7f0e99e70700>' {{(pid=118488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 16:47:30.316883 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO nova.api.openstack.requestlog [None req-286d0db3-8012-4d31-bcc1-54cdc88eadbc tempest-TestVolumeBootPattern-738085405 tempest-TestVolumeBootPattern-738085405-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-776713563" status: 202 len: 0 microversion: 2.1 time: 0.108811 May 27 16:47:30.317507 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: [pid: 118488|app: 0|req: 635/1268] 10.222.0.42 () {58 vars in 1259 bytes} [Fri May 27 16:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-776713563 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 16:50:26.289178 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:50:26.289885 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:50:30.102771 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:50:30.103355 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:50:36.430269 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:50:36.430823 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:50:45.607487 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:50:45.608149 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:52:24.467359 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:52:24.468006 dv-cinder-840493-2-iscsi devstack@n-api.service[118488]: Fri May 27 16:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:52:35.006078 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:52:35.006640 dv-cinder-840493-2-iscsi devstack@n-api.service[118487]: Fri May 27 16:52:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!